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Abstract 

We consider surfaces immersed in three-dimensional pseudohermitian manifolds. 
We define the notion of (p-)mean curvature and of the associated (p-)minimal 
surfaces, extending some concepts previously given for the (flat) Heisenberg group. 
We interpret the p-mean curvature not only as the tangential sublaplacian of a 
defining function, but also as the curvature of a characteristic curve, and as a 
quantity in terms of calibration geometry. 

As a differential equation, the p-minimal surface equation is degenerate (hy- 
perbolic and elliptic). To analyze the singular set, we formulate some extension 
theorems, which describe how the characteristic curves meet the singular set. This 
allows us to classify the entire solutions to this equation and to solve a Bernstein- 
type problem (for graphs over the xj/-plane) in the Heisenberg group Hi. In Hi, 
identified with the Euclidean space R^, the p-niinimal surfaces are classical ruled 
surfaces with the rulings generated by Legendrian lines. We also prove a uniqueness 
theorem for the Dirichlet problem under a condition on the size of the singular set 
in two dimensions, and generalize to higher dimensions without any size control 
condition. 

We also show that there are no closed, connected, smoothly immersed con- 
stant p-mean curvature or p-minimal surfaces of genus greater than one in the 
standard S^. This fact continues to hold when is replaced by a general spherical 
pseudohermitian 3-manifold. 
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1. Introduction and statement of the results 

Minimal surfaces in a Riemannian manifold play an important role in the study 
of topology and geometry of the ambient manifold. For instance, the positive mass 
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theorem originally was proved with the aid of minimal surface theory ([SY]). In 
order to study the mass in an analogous manner or to formulate a boundary value 
problem for prescribing the Webster scalar curvature on a domain with boundary 
in pseudohermitian geometry, we find it necessary to formulate a notion of mean 
curvature for a surface in a pseudohermitian manifold. 

Let S be a surface in a 3-dimensional pseudohermitian manifold (see the Appen- 
dix for some basic facts in pseudohermitian geometry, and Section 2 for rigorous 
definitions). To every non-singular point of S, we associate a vector field normal 
to E, called the Legendrian normal. If for example E bounds some smooth set Q, 
then the p-area, in analogy with the Riemannian case, is obtained as the variation 
of the volume of O in the direction of the Legendrian normal, see formulas (2.4) 
and (2.5). 

The p-mean curvature of E is in turn given by the first variation of the p-area. 
It is easy to see that H equals the negative subdivergence of the Legendrian normal 
62. Suppose V is a defining function of E such that 62 = VtV/IVbV'lG {G is the 
Levi metric. See the definition in Section 2). Then the p-mean curvature equation 
and the p-minimal surface equation {H = 0) read 

(pMCE) - rfW6(V6^/|V6V|G) = H 

and 

(pMSE) divb{Vbi^/\Vbi^\G) = 0, 

respectively. 

Alternatively, having in mind the Gauss map, the mean curvature can be de- 
fined in terms of the covariant derivative (with respect to the pseudohermitian 
connection) along S of the Legendrian tangent ei to S, see (2.1). 

Of course the case of the Heisenberg group as a pseudohermitian manifold is one 
of the most important. Indeed it is the simplest model example, and represents a 
blow-up limit of general pseudo-hermitian manifolds. In the case of a smooth sur- 
face in the Heisenberg group, oiu' definitions coincide with those given in ([CDG]), 
([DGN]) and ([Pau]). In particular these notions, especially in the framework of ge- 
ometrci measure theory, have been used to study existence or regularity properties 
of minimizers for the relative perimeter or extremizers of isoperimctric inequalities, 
see (DGN), ([GN]), ([LM]), ([LR]), ([Pan]). The p-area can also be identified with 
the 3-dimensional spherical Hausdorff measure of S (see, e.g., [B], [FSS]). 

In this paper, we study the subject mainly from the viewpoint of partial diff'er- 
ential equations and that of difi^erential geometry. Our basic results are the analysis 
of the singular set (see Section 3). As consequences, we can prove a Bernstein-type 
theorem (sc!c Section 4 and Theorem A) and the nonexistence of closed hyperbolic 
p-minimal surfaces (see Section 7 and Theorem E). We also establish a comparison 
theorem (see Section 5) which is a substitute for the maximum principle and may 
become a useful tool in the subject. 

For a p-minimal graph {x,y,u{x,y)) in the Heisenberg group Hi, the above 
equation {pMSE) reduces to 



(pMGE) {Uy + xfUxX - 2{Uy + X){Ux - y)Uxy + {Ux - y^Uyy = 
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by taking ^l; = z — u{x, y) on the nonsingular domain. This is a degenerate (hy- 
perbolic and elhptic) partial differential equation. It is degenerate hyperbolic (on 
the nonsingular domain) having only one characteristic direction (note that a 2- 
dimensional hyperbolic equation has two characteristic directions [Jo]). We call the 
integral curves of this characteristic direction the characteristic curves. We show 
that the p-mean curvature is the line curvature of a characteristic curve. Therefore 
the characteristic curves of (pMGE) are straight lines. Moreover, the value of u 
along a characteristic curve is determined in a simple way (see (2.22), (2.23)). 

The analysis of the singular set is necessary to characterize the solutions. As 
long as the behavior of H (consider (pMCE) for a graph in Hi) is not too bad 
(say, bounded), we show that the singular set consists of only isolated points and 
smooth curves (see Theorem B below) . Under a quite weak growth condition on H, 
a characteristic curve F reaches a singular point po in a finite arc-length parameter 
and has an approximate tangent. From the opposite direction, we find another 
characteristic curve F' reaching also po with the opposite approximate tangent. 
The union of F, po, and F' forms a smooth curve (see Corollary 3.6 and Theorem 
3.10). Making use of such extension theorems, we can easily deal with the singular 
set, in order to study the Bernstein problem. Namely, we study entire p-minimal 
graphs (a graph or a solution is called entire if it is defined on the whole a;y-plane). 
The following are two families of such examples (cf. [Pau]): 

(1.1) u = ax + by + c {sl plane with a,b,c being real constants); 

(1.2) u = -abx^ + (a^ - h'^)xy + aby"^ + g{-bx + ay) 

{a, b being real constants such that + 6^ = 1 and g G C^). 

We have the following classification result (see Section 4). 

Theorem A. (1.1) and (1.2) are the only entire smooth solutions to the p- 
minimal graph equation (pMGE). 

To prove Theorem A, we analyze the characteristic curves and the singular set 
of a solution for the case H = 0. Observe that the characteristic curves are straight 
lines which intersect at singular points. Let S{u) denote the singular set consisting 
of all points where Ux — y = and Uy + x = 0. Let N{u) denote the xy— plane 
projection of the negative Lcgendrian normal —62. It follows that N(u) — [u^ — 
y,Uy + x)/D where D = {ux — y)^ + {uy + x)^. On the nonsingular domain, 
(pMGE) has the form 

divN{u){^ H) = 0, 

where div denotes the xy-plane divergence. The following result gives a local de- 
scription of the singular set (see Section 3). 

Theorem B. Let fl be a domain in the xy— plane. Let u G C^(fl) be such that 
divN{u) = H in 0\S{u). Suppose \H\ < near a singular point po G S{u) where 

r{p) = \p — Po\ for p S f2 and C is a positive constant. Then either po is isolated 
in S{u) or there exists a small neighborhood of po which intersects with S{u) in 
exactly a smooth curve past po- 
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We show that the restriction on H is necessary by giving a C°° smooth coun- 
terexample. In additon the blow-up rate H = is realized by some natural 
examples (see Section 3). Theorem B follows from a characterization for a singular 
point to be non- isolated (see Theorem 3.3). 

When two characteristic lines meet at a point of a singular curve, they must 
form a straight line (see Lemma 4.4). So we can describe all possible configurations 
of characteristic lines as if singular curves are not there. It turns out that there 
are only two possible configurations of characteristic lines. Either all characteristic 
lines intersect at one singular point or they are all parallel. In the former case, 
we are led to the solution (1.1) while for the latter case, (1.2) is the only possible 
solution. 

The characteristic curves on a p-minimal surface are the Legendrian geodesies 
(see (2.1)). Since the Legendrian geodesies in Hi are nothing but straight lines, a 
general complete p-minimal surface is a complete ruled surface generated by Legen- 
drian rulings. We will discuss this and point out that a known complete embedded 
non-planar p-minimal surface has no singular points (characteristic points in the 
terminology of some other authors) after (4.10) in Section 4. 

Since {pMGE) is also a degenerate elliptic partial differential equation, one can 
use non-degenerate elliptic equations to approximate it. With this regularization 
method, Pauls ([Pan]) obtained a W^^'P Dirichlet solution and showed that such 
surfaces are the X-minimal surfaces in the sense of Garofalo and Nhieu ([GN]). 
In general the solution to the Dirichlet problem may not be unique. However, we 
can still establish a uniqueness theorem by making use of a structural equality of 
"elliptic" type (Lemma 5.1). More generally we have the following comparison 
principle. 

Theorem C. For a bounded domain Q. in the xy-plane, let u,v € (7^(0) fl C°(f2) 
satisfy divN{u) > divN{v) in il\S and u < v on dCl where S = S{u) U S{v). 
Suppose 'Hi{S), the 1-dimensional Hausdorff measure of S, vanishes. Then u < v 
in fl. 

As an immediate consequence of Theorem C, we have the following uniqueness 
result for the Dirichlet problem of (pMGE) (see Section 5). 

Corollary D. For a bounded dom,ain O in the xy-plane, let u,w G (7^(51) H C°(r2) 
satisfy divN{u) = divN{v) = in i}\S and u = v on dfl where S = S{u) U S{v). 
Suppose Hi{S), the 1-dimensional Hausdorff measure of S, vanishes. Then u = v 
in fl. 

We remark that the condition on 'Hi{S) in Corollary D is necessary. A coun- 
terexample is given in [Pau] with Hi{S) ^ 0. We generalize Theorem C to higher 
dimensions and for a class of general (sec Section 5). It is noticeable that we 
do not need the condition on the size control of the singular set for the higher 
dimensional version of Theorem C (see Theorem C'). 

We also study closed p-minimal surfaces in the standard pseudohermitian 3- 
sphere. A characteristic curve of such a p-minimal surface is part of a Legendrian 
great circle (see Lemma 7.1). Using this fact, we can describe the extension the- 
orems (Corollary 3.6, Theorem 3.10 or Lemma 7.3) in terms of Legendrian great 
circles, and hence give a direct proof of the nonexistence of hyperbolic p-minimal 
surfaces embedded in the standard pseudohermitian 3-sphere (part of Corollary F). 
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Then we generalize to the situation that the ambient pseudohermitian 3-manifold 
is spherical and the immersed surface has bounded p-mean curvature (see Section 
7). 

Theorem E. Let M be a spherical pseudohermitian 3-manifold. Let T, be a closed, 
connected surface, smoothly immersed in M with bounded p-mean curvature. 
Then the genus ofT, is less than or equal to 1. In particular, there are no constant 
p-mean curvature or p-minimal surfaces S of genus greater than one in M. 

There are many examples of spherical CR manifolds, and there have been many 
studies in this direction (e.g., [BS], [KT], [FG], [CT], [S] ). We speculate that The- 
orem E might imply a topological constraint on a spherical CR 3-manifold. The 
idea of the proof for Theorem E goes as follows. A spherical pseudohermitian man- 
ifold is locally the Hoisenberg group with the contact form being a multiple of the 
standard one. So locally near a singular point, S is a graph in Hi having bounded 
p-mean curvature with respect to the standard contact form. We can then apply 
Lemma 3.8 to conclude that the characteristic line field has index at every iso- 
lated singular point. Therefore the Euler characteristic number (equals the index 
sum), hence the genus, of S has constraint in view of the Hopf index theorem for 
a line field. 

Corollary F. There are no closed, connected, smoothly immersed constant p- 
mean curvature or p-minimal surfaces of genus >2 in the standard pseudohermitian 
3-sphere. 

Note that in the standard Euclidean 3-sphcrc, there exist many closed C°° 
smoothly embedded minimal surfaces of genus > 2 ([La]). 

On a surface in a pseudohermitian 3-manifold, we define an operator, called the 
tangential sublaplacian. The p-mcan curvature is related to this operator acting on 
coordinate functions (see (2.19o), (2.196), (2.19c)) for a graph in Hi. We therefore 
obtain a "normal form" (see (2.20)) of (pMGE). We also interpret the notion of 
p-mean curvature in terms of calibration geometry. From this we deduce the area- 
minimizing property for p-minimal surfaces (see Proposition 6.2). Since the second 
variation formula is important for later development, we derive it and discuss the 
stability of a p-minimal surface in Sections 6 and 7. 

We remark that, in the preprint ([GPl]), the authors claim the vertical planes are 
the only complete p-minimal graphs having no singular points (non-characteristic 
complete minimal graphs in their terminology). This is faulty. For instance, y = xz 
is a complete (in fact, entire) p-minimal graph over the xz-plane and has no singular 
points. In [CH], two of us classify all the entire p-minimal graphs over any plane 
among other things. After our paper was completed, we were informed that the 
above claim had been corrected and some similar results are also obtained in the 
new preprint ([GP2]). 

Acknowledgments. We would like to thank Ai-Nung Wang for informative dis- 
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The first author would also like to thank Yng-Ing Lee for showing him some basic 
facts in calibration geometry. We began this research during the first author's visit 
at the IAS, Princeton in the 2001-2002 academic year. He would therefore like 
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2. Surfaces in a 3-dimensional pseudohermitian manifold 

Let (M, J,0) be a 3-dimensional oriented pseudohermitian manifold with a CR 
structure J and a global contact form O (see the Appendix). Let S be a surface 
contained in M. The singular set consists of those points where ^ coincides 
with the tangent bundle TS of S. It is easy to sec that 5*2 is a closed set. On 
the nonsingular (open) set we call the leaves of the 1-dimensional foliation 

^ n TE the characteristic curves. These curves will play an important role in our 
study. On ^, we can associate a natural metric G = |(iO(-, J-), called the Levi 
metric. For a vector u €E ^, we define the length of v by \v\g = (G'(w, f ))"'^/^. With 
respect to this metric, we can take a unit vector field ei G ^ fl TS on S\S's, called 
the characteristic field. Also associated to (J, 6) is the so-called pseudohermitian 
connection, denoted as V^'^' (see (A. 2) in the Appendix). We can define a notion 
of mean curvature for S in this geometry as follows. Since V^ ''' preserves the Levi 
metric G, V^ ^' ei is perpendicular to ei with respect to G. On the other hand, it 
is obvious that G(ei,e2) = where 62 = Jei. We call 62 the Legendrian normal or 
Gauss map. So we have 



(2.1) Vfi^-ei = He2 

for some function H. We call H the p(pseudohermitian)-mean curvature of S. Note 

that if we change the sign of ei, then 62 and H change signs accordingly, li H = 0, 
we call S a p-minimal surface. In this situation the characteristic curves are nothing 
but Legendrian (i.e., tangent to ^) geodesies with respect to the pseudohermitian 
connection. 

We are going to give a variational formulation for the p-mean curvature H. First 
let us find a candidate area integral. Suppose O is a smooth domain in M with 
boundary dfl = S. Consider V{Q), the volume of O, given by 




(i is a normalization constant. For Q C this volume is just the usual Euclidean 
volume). Take Legendrian fields 61,62 = Jei e ^, orthonormal with respect to G, 
wherever defined in a neighborhood of S (note that we do not rcqiiire ci to be 
characteristic, i.e. tangent along S here). We consider a variation of the surface S 
in the direction /62 where / is a suitable function with compact support in T,\Sj:. 
The vector field /e2 generates a fiow (ft for t close to 0. We compute 



(2.2) Sfe^ViQ) = lu^,V{M^)) = ll|,=o^<Pr(e AdO) 

It follows from the formula Lx = doix + ix°d (ix denotes the interior product 
in the direction X) that 
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(2.3) Lfe^{&Ade)=doif^^{QAdQ). 
Substituting (2.3) in (2.2) and making use of Stokes' theorem, we obtain 

(2.4) Sf,,V{fl) = ^jjf,,{QAd@) = jjQA e\ 

Here together with e^, O form a dual basis of (ei, e2, T) where T is the Reeb vector 
field (uniquely determined by Q{T) = 1 and ird® = 0). Note that dQ = 2e^ A 
(see {A.lr)). For ei being a characteristic field, we define the p-area of a surface E 
to be the surface integral of the 2-form 6 A : 

(2.5) p- Area(S) = / 6 A 

JT, 

Note that O A continuously extends over the singular set 5s and vanishes on 
Sy,- In fact, we can write with respect to a dual orthonormal basis {e^, e^} of ^, 
which is smooth near a singular point, say pq, as follows: = cos/3e^ + sin/3e^. 
Here (3 may not be continuous at po- Now A and 8 A tend to on S as 
p e S tends to po since 9 vanishes on Tp^S = . It follows that 6 A tends to 
on S as p € S tends to po since cos/3 and sin/3 are bounded by 1. 

We can recover the p-mean curvature H from the first variation formula of the 
p-area functional (2.5). We compute 

(2.6) <5/e. / Q^e^= j Lf,,{@Ae^)= f if,, o die A e^). 

JT JT JT 

Here we have used the formula Lx = d o ix + ix ° d, and the condition that / is a 
function with compact support away from the singular set and the boundary of E. 
Prom the equations dQ = 2e^ A and de^ = — A lo mod 9 (see (A.lr), (A.3r)), 
we compute 

(2.7) d(9 A e^) = rf9 A - 9 A de^ = 9 A A w. 

Substituting (2.7) into (2.6), we obtain by the definition of the interior product 
that 

(2.8) 6fe2 I eAe^= / /(-e Aa; + a;(e2)e Ae^) 

Jt Jt 

= ^-/w(ei)9Aei 
(9 A = on S since ei is tangent along E) 
= -J fHQAe^. 

In the last equality, we have used the fact that H = uj{e\) (obtained by comparing 
(2.1) with (A.2r)). Similarly we can also compute the first variation of (2.5) with 
respect to the field gT where (/ is a function with compact support away from the 
singular set and the boundary of E. Together with (2.8), the result reads 
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(2.8') Sfe,+gT / OA el = -/(/- ag)He A e\ 

Here we define the function a on T\Sy, such that ae2 + T e TS. We leave the 
deduction of (2.8') to the reader. Let V be a defining function of E. It follows that 
the subgradient VbV' = (eiV')'5i + (e2V-')c2 = (g2^^)'^2 since ei G TE, hence ei'i/' = 0. 
So Vb^/IVbVIc = 62 (change the sign of ^ if necessary). Next we compute the 
subdivergence of 62. Since W^'^' preserves the Levi metric G, we can easily obtain 
G(VP-^ e2,e2) = and G(Vf;'' e2, ei) = -G(e2, Vf^'^ ei) = -H by (2.1). Therefore 
divb{e2) = G(VPf 62,61) + G{VP.I'-e2,e2) = -H. We have derived the p-mean 
curvature equation (pMCE) and the p- minimal surface equation [pMSE): 

(pMCE) -divb{VbiP/\Vki>\G) = H 

and 

(pMSE) rfm(V6V'/|V6V|G)=0, 
respectively. 

For a graph (a;, y, u(a;, y)) in the 3-dimensional Heisenberg group H\, we can take 
tp = z — u{x, y). Then (at a nonsingular point) up to sign, ei is uniquely determined 
by the following equations: 

(2.9a) Qq = dz + xdy — ydx = 0, 

(2.9b) dijj = d{z - u{x, y)) = 0, 

(2.9c) G(ei,ei) = ideo(ei,Jei) = l. 

Using (2.9a), (2.9c), we can write ei = /ei + 562 with P + = 1, in which 
^1 ~ ^ 2/^' ^2 = ^ — are standard left-invariant Legendrian vector fields 
in Hi (sec the Appendix). Applying (2.95) to this expression, wc obtain {ux — 
y)f + {uy + x)g = 0. So {f,g) = ±{-{uy + x),u^ - y)/[{u^-yf + {uy + xfYl'^ 
(positive sign so that Vb'^/IVbVlG = 62 = —\{ux — y)ei + {uy + x)e2]/D where 
D = [{v,,: - yf + {uy + .r)2]i/2)_ Nqw from [pMCE) we obtain a formula for H 
through a direct computation: 

(2.10) H = D~^{{uy + xfuxx - ^Uy + x){ux - y)uxy + [u^ - y)'^Uyy}. 

At a nonsingular point, the equation (pMSE) reduces to the p-minimal graph 
equation (pMGE) : 

(pMGE) {uy + xfuxx - 2(% + x){ux - y)uxy + {u^ - yYuyy = 0. 

In fact, if u is smooth, the p-mean curvature H in (2.10) vanishes on the 
nonsingular domain (where D 7^ 0) if and only if {pMGE) holds on the whole 
domain. We can also compute = D~^{—{uy + x)dx -\- {ux — y)dy} and express 
the p-area 2-form as follows: 

(2.11) e A = Ddx Ady= [{ux - yf + {uy + xff/'^dx A dy. 
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At a singular point, the contact form is proportional to dtp (see (2.9a), (2.96)). 
Therefore — y = 0,Uy + x = describe the xy— plane projection S{u) of the 
singular set S-e: 



(S) 



'S'(w) = {(a;, y) € : Ux - y ^ 0,Uy + X = 0}. 



Prom (2.11) we see that the p-area form O A is degenerate on S{u) or Sj:. 

Let 62 be the Legendrian normal of a family of deformed surfaces foliating a 
neighborhood of E. We define the tangential subgradient Vj^ of a function / defined 
near E by the formula: V^/ = Vf,/ — G(V6/, 62)62 (see (A.8) for the definition of 
Vb/) and the tangential pseudohermitian connection v*'^ ''' of a Legendrian (i.e. 
in ^) vector field X by V*f '' X = Vf-^' X - G(Vp-'' X, 62)63. Then we define the 
tangential sublaplacian of / by 



where divl{X) is defined to be the trace of V*'^''*'X considered as an endomorphism 
of ^ w ^ Vy^''^'X. Now for an orthonormal basis ei, 62 of $, with respect to G, we 
have 



(2.13) divliX) = G(V*f ''•X, ei) + G(V*-f '''X, 62) = G(V*f '''X, ei) 

since Wlf '^ X is proportional to 61. On the other hand, we write Vb/ — {eif)ei + 
(62/)e2 (cf. {A.8r)). It follows that V^/ = (ei/)6i. Setting X = = (6i/)6i 
in (2.13) and noting that V*f''-6i = by (2.1) gives divliylf) = {eif f + 
(ei/)G(V*f-'' ei,6i) = (ei)2/. Substituting this in (2.12), we obtain 

(2.14) A*/ = (6i)V. 



Note that (2.14) holds for a general surface E contained in an arbitrary pseudoher- 
mitian 3-manifold. We also note that A^ + 2q!6i is self-adjoint with respect to the 
p-area form 6 A as shown by the following integral formula: 



for smooth functions /, g with compact support away from the singular set. The 
proof is left to the reader (Hint: observe that the adjoint of ei is — ei — 2a by 
noting that © A 6^ = and 6^ A 6^ = ae^ A O on the surface). When E is a graph 
(x, y, u{x, y)) in Hi, we can relate (61)^/ for f = x,y, ot u to the p-mean curvature 
H. Denote the projection of —62 (— ei, respectively) onto the xy-plane by N{u) or 
simply N {N-^{u) or simply N-^, respectively). Recall that 61 = [—{uy + x)ei + 
{ux — y)e2]/D where D — [{ux — yY + {uy+xYy-/'^ (see the paragraph after (2.9)). So 
N-^ = [{uy + x)dx — {ux — y)dy]/D. Write {uy + x)D~^ = sin 6*, {u^ — y)D~^ = cos 6* 
for some local function 6. Then we can write 



(2.12) 



A*/ = divliVlf) 



[ [fAlg - gAlf]& Ae'=2 [ [g{eif) - f{eig)]ae A e' 




(2.15a) 
(2.15b) 



N = {cose)dx + {sme)dy, 
N-^ = {siTie)dx - (cos6l)9j 
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First note that from [pMCE) we can express the p-mean curvature H as follows: 



(2.16) H = divN = {cos 6)^ + {sme)y = -(sin6l)6'x + {0036)6^ 
Now starting from (2.156) and using (2.16), we can deduce 

(2.17) {N^f = sm^edl - 2sm9 cosed^dy + cos^ 0d^ 

- {cos9)Hd^ - {sine)Hdy. 
On the other hand, we can write (2.10) in the following form: 

(2.18) H = D-\sm^ ed^u - 2 sin 61 cos (99^ 9yU + cos^ ed^u). 
Applying (2.17) to x,y,u{x,y), respectively and making use of (2.18), we obtain 



(2.19a) 
(2.19b) 
(2.19c) 



Alx = {eifx = {N^fx = -{cos9)H, 
Aly = {eify = {N^)^y = -{sm6)H, 
A^u = {eif u = {N^fu = D-\xUy - yu^ + a;^ + y'^)H 



= H{x sin ^ — y cos 0) = H det 



X y 
cos 6 sin 6 



(here " det" means determinant}. Formula (2.19c) gives the following normal form 
of {pMGE) : 

Lemma 2.1. For a smooth p-minimal graph u = u{x, y) in the 3-dimensional 
Heisenberg group Hi, we have the equation 



Alu = {eiYu = {N^yu = 



(2.20) 

on the nonsingular domain. 

Also from (2.19a) and (2.196), we have A^x = Aly = on a p-minimal graph 
S = {{x,y,u{x,y))}. Together with (2.20), we have Al{x,y,z) = (A^x, A^y, A^z) 
= (0,0,0) (i.e., A^ annihilates the coordinate functions) on S. This is a property 
analogous to that for (Euclidean) minimal surfaces in ([Os]). In general, we 
have 



Al{x,y,z) = He2 

Wo will often call the xy— plane projection of characteristic curves for a graph 
{x, y, u{x, y)) in Hi still characteristic curves if no confusion occurs. Note that the 
integral curves of A''-'- are just the a;y— plane projection of integral curves of ei. So 
they are characteristic curves. Along a characteristic curve {x{s),y{s)) where s is 
a unit-speed parameter, we have the equations 



(2.21) 



■ cost 



dx . n d.y 
— =sme, — 
as as 

by (2.15b). Noting that Ux = {cos9)D + y, Uy = {sm9)D — x, we compute 
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du dx dv 

(2.22) — =ux— +uy-j- = [{cos9)D + y\sm.e + [(sin0)D - a;] (-cos 6*) 

(J/h (Jib (liO 

= X cos 6 + y sin 9, 

— = o — + e — 

ds ^ ds ^ ds 

by (2.16). In general, we can consider H as a function of x,y,u,9 in view of the 
O.D.E. system (2.21), (2.22) and (2.23). From (2.21) and (2.23), we compute 



(2.23) — = 0^—+ey^ = e^sine -OyCosO = -H 



(2.24) =-Hcose, --^ = -Hsme. 



d'^x „ „ d'^y 

Observe that (cos0,sin0) is the unit normal to the unit tangent (^, ^) = (sin^, 
— cos^). So —H is just the curvature of a characteristic curve. In particular, when 
H = {), characteristic curves arc nothing but straight lines or line segments (see 
Proposition 4.1 and Corollary 4.2). 



3. The singular set-proof of Theorem B 

Let be a domain (connected open subset) in the ccy-plane, and let u G C^{il). 
Let E = {(a;, y, u{x, y) \ {x, y) G O,} C Hi. In this section, we want to analyze S{u) 
(still called the singular set), the plane projection of the singular set S-e, for 
the graph S. 

First for a,b G R, + b'^ = 1, we define Fa,b = a{ux — y) + b{uy + x) and Va,b = 
{{x,y) e I Fa,b{x, y) = 0}. Then it is easy to see that Ta,b = S{u) U {{x, y) e O | 
N{u){x, y) = ±{b, -a)}. Let 

j-y-j jj _ UXX Uxy — 1 

'^xy ~t~ 1 '^yy 

Lemma 3.1. Let u G C^(0) and let po G S{u) C ft. Then there exists a small 
neighborhood of po, whose intersection with S{u) is contained in a smooth 
curve. 

Proof. Compute the gradient of Fa^b '■ 



(3.1) 



VFa,6 = {auxx + h{uxy + 1), a{uxy - 1) + buyy) 



= ia,b) 



+ 1 



^xy 



^yy 



= {a, b)U. 



Note that U is never a zero matrix since Uxy + 1 and Uxy — 1 can never be zero 
simultaneously. So there exists at most one unit eigenvector (ao,6o) of eigenvalue 
up to a sign for U at po. For (a, 5) ^ ±(ao,6o), ^Fa^b 7^ at po- Then by the 
implicit function theorem, there exists a small neighborhood of pq. in which Ta,b 
at least for (0,6) ^ ±(ao,6o) forms a smooth curve. On the other hand, it is 
obvious that S{u) is contained in Ta,b- We are done. 

Q.E.D. 
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Lemma 3.2. Let u G C^(f2) and suppose po G S{u) C O is not isolated, i.e., 
there exists a sequence of distinct points pj G S{u) approaching po. Then det U{po) 
is zero. 

Proof. Let Ta.b be the smooth curve as in the proof of Lemma 3.1. Since 
Ta,b is smooth near po, we can take a parameter s of unit speed for Ta^b near 
Po, and find a subsequence of pj, still denoted as pj, pj = (x, y){sj),pa = {x, y){so) 
such that Sj tends to ,so monotonically. Since {u^ — y){pj) = {u^ — y){x, y){sj) = 
for all j, there exists Sj between Sj and Sj+i such that d{ux — y)/ds = at Sj. So 
by the chain rule we obtain 



UjUj , , U/U 

(3.2a) Uxx— + {Uxy-'i-)— =0 



at Sj and at sq by letting Sj go to sq- Starting from {uy+x){pj) = {uy+x){x, y){sj) 
0, we also obtain by a similar argument that 



(3.2b) ^^'''"'^^^'ds'^^^^'ds^^ 

at sq. But (^, ^) 7^ since s is a unit-speed parameter. It follows from (3.2a), 
(3.25) that det U{po) = 0. 

Q.E.D. 

Note that we do not assume any condition on H in Lemma 3.1 and Lemma 3.2. 
If we make a restriction on H, we can obtain the converse of Lemma 3.2. 

Theorem 3.3. Let U be a domain in the xy— plane. Let u S (7^(17) be such 
that divN{u) = H in fl\S{u). Suppose \H\ < near a singular point po £ S{u) 
where r{p) = \p — Pq\ for p £ Q, and C is a positive constant. Then the following 
are equivalent: 

(1) Po is not isolated in S{u), 

(2) detUipo)=0, 

(3) there exists a small neighborhood of po which intersects with S{u) in 
exactly a smooth curve past po. 

Proof. (1)^(2) by Lemma 3.2. (3)=>(1) is obvious. It suffices to show that 
(2)=>(3). Suppose detU{po) = 0. Note that U{po) ^ 0— matrix since the off- 
diagonal terms u^y + 1 and u^y — 1 in (?7) can never be zero simultaneously. There- 
fore rank{U{po)) = 1, and there exists a unique (ao,feo), up to sign, such that 
{ao,bo)U = at po. So for any (a, 6) ^ ±(ao,6o), Fa^b = a{ux - y) + b{uy + x) 
satisfies Vi^o,6 ^ at po and for (ai,6i) ^ ±(ao, ''o)) (^2, ^2) 7^ ±(aO)&o) and 
(ai,6i) 7^ ±(02,62) 



(3.3) ^Fa,,b^^C^Fa,M2 

at Po where c is a nonzero constant. Therefore Fa^^bi and Fa2,b2 are smooth 
curves in a neighborhood of po (recall that is defined by Fa,b = 0). Also Tai,bi 
and Fas. fa, are tangent at po- Thus we can take unit-speed arc-length parameters s, 
t for Fai.bi, Laj.ba described by 71 (s), 72(0) respectively, so that 71 (0) = 72(0) = po 
and 7^(0) = 7^(0). Observe that 
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('/■O7i)'(0+) = (ro72)'(0+) = 1 
(ro7i)'(0-) = (ro72)'(0-) = -1. 

Therefore we can find a small e > such that (ro7i)'(s), (r"072)'(t) > for s,t > 

((ro7i)'(s), (ro72)'(f) < for s,t < 0, respectively) whenever 7i(s),72(i) & i?e(po), 
a ball of radius e and center po. Also note that S{u) fl Be{po) C Tai,bi,i = Ij 2. We 
can write 



(r,„,, n BM)\s{u) = u-i7i(]4'*t[) ^ u=li7i(]^*7' Vt) 
(r„„fa, n BM)\s{u) = u- i72(]t+ ?+[) u u- 172(1*7, 

where ]s'j , Sj' [,]sj , sj [, etc. denote open intervals and we have arranged 



si < h <..s^ < <,s^.+i < .5^-+i<..<0<..<s++i < S++i<s+ < S+<..<s+ < s+ 
ti < i^<..t- < i~<t-^i < i7+i<"<0<"<i/+i < it+i-*t < i+<..<tt < if 

(if there are only finite number of open intervals for negative (positive, respectively) 

s, then sj = sj = ,s~ (s^ = .5^ = .s+ , respectively) for j>m,, a certain integer, 
by convention. Note that 57 or s'j may equal for some finite j. In this case, 
all the s with subindex larger than j equal 0. We apply the same convention 
to the parameter t). Since ro"fi and ro72 arc monotonic (increasing for positive 
parameters and decreasing for negative parameters), we actually have 7i(s^) = 
l2itf), liisf ) = 72iif ) except possibly 71 (sj^) ^ 72(^7) or 71 (s^) ^ 72(^7)- Let 
Cj = 71(5^") and ij = 7i(s^). Then either Tai^bi and Ta2,b2 meet at ei or 62, or 
they do not meet in B^{pq)\{p()} for positive parameters. In the former situation, 
we need to show that Cj, i > 1, does not converge to po as z ^ 00 (then there 
is a smaller ball B^i{po) such that S{u) fl B^i{pq) contains 7i([0,s+[) for a small 
5+ > 0). Suppose it is not so. Let Vli be the region surroimded by Ta^fi^ and Fo^^bj 
from Cj to Ci for all i > 1 or 2 (if 71 (s^) 7^ 72(^7)) (note that the curves Tai,bi 
and Faj.fts only meet at singular points since {a\,h\) 7^ ±(a2, 62), i.e., points of the 
arcs 7i{[sfj^i. sf]) = 72([^7i-i' ^i'"])-) Observe that Fa^.b^ and Ta-iM asymptotically 
approximate the same straight line by (3.3). So the distance function r{p) = \p—po\ 
is one-to-one for p G Faj ^bi (Fas M , respectively) near po with parameter s > {t > 0, 
respectively) since (ro7i)'(.s), (ro72)'(t) > for s,t > as shown previously. Now 
we want to compare both sides of 



(3.4) f iV(w)-z/rfs= / / divN{u)dxdy = / / Hdxdy 

where v is the unit outward normal to Fo^^b^ and Fa^.fca- On Taifii{Ta2,b2J respec- 
tively), N{u) _L (ai,6i) ((02,62), respectively). So N{u) is a constant unit vector 
field along Fa^ (Faj.bj , respectively). On the other hand, v approaches a fixed unit 
vector i/Q = VFai,6i(po)/|VFa^,6i(po)| = VFa2,b2(j3o)/|Vi^a2,b2(j5o)| as ei,ei tend to 
Po for i large. It follows that N{u) ■ v tends to a constant c\ = ±(— 6i,ai) • uq 
(c2 = ±(-62, a2) • i^a, respectively) along Fa^^b^ (Fa^^b^ , respectively) as i goes to 
infinity. We choose (in advance) (ai,6i) ^ ±(02,62) (also both ±(ao,6o)) such 
that ci 7^ C2. Thus we can estimate 
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(3.5) \(f N{u)-uds\>{\c,-C2\-di)\r{ei)-r{ei)\ 

JdQi 

for some small positive Si that goes to as i ^ oo. On the other hand, we can 
make fli contained in a fan-shaped region of angle 9i with vertex po so that 0i ^ 
as i — > oo. We estimate 

(3.6) I / / Hdxdy \<\ / ' "\ / ' -de)rdr \< COi \ r{ei) - r{ei) \ . 

J JUi Jr{ei) Jo f 

Substituting (3.5) and (3.6) into (3.4), we obtain 

(I ci - C2 I I r{ei) - r(e,) |< CO, \ r{ei) - r{ei) \ . 

Hence | ci — C2 | —5i < COi. But 5i and 9i tending to gives ci = C2, a contradiction. 
Another situation is that rai,bi and Faa.ba do not meet in a small neighborhood of 
Po except at po for s, t>Q. In this case, let be the region surrounded by Ta^^^, 
ro2,62) ^■iid dBri{po) for large i and contained in a fan-shaped region of angle 9i 
with vertex po so that ri ^ 0, —> as i —> oo. Observing that the arc length of fij 
n dBr^{po) is bounded by OiVi, we can reach a contradiction by a similar argument 
as above. For s,t < 0, we apply a similar argument to conclude that there is a 
small e" > such that S{u) n B^"{po) contains 7i(]s~, 0]) for a small s~ < 0. Now 
an even smaller ball of radius < min{e' , e") and center po will serve our purpose. 

Q.E.D. 

Proof of Theorem B : 

It is an immediate consequence of Theorem 3.3. 

Q.E.D. 

We remark that Theorem B does not hold if we remove the condition on H. 

Example 1. Let u = xg{y). Then Ux = g{y),Uy = xg'{y). It follows that 
the singular set S{u) = {g{y) = y and g'{y) + I = 0} U {g{y) = y and x = 0}. 
Take g{y) = exp(-^) sin(-i) + y. Compute g'{y) = 2exp(-^)y-3 sin(-i) + 

exp(— p-)y~^ cos(— i) -|- 1. So for j/ small, g'{y) + 1=0 has no solution. Therefore 
S{u) (when y is small) = {g{y) = y, x = 0} ~ {sin(— i) = 0, a; = 0} has infinitely- 
many points near (0,0). Note that g, hence u, is C°° smooth. This example shows 
that even for u G C°° , S{u) may contain non- isolated points which do not belong 
to curves in S{u). On the other hand, the p-mcan curvature H{u) has a blow-up 
rate exp(;^) for a certain sequence of points {xj,yj) satisfying Xj = exp(— ^) and 

converging to (0, 0). 

Example 2. Let u = ±^{x'^+y'^). Then = ±x, Uy = ±y. So S{u) = {(0, 0)}. 
By (2.10) we compute the p-mean curvature H = ±2~^/^r~^ where r = y/x'^ + y'^. 
This is the case that the equality of the condition on H holds. 

Example 3. The following example shows that in Theorem 3.3, (2) does not 
imply (1) if we remove the condition on H. Let 

u = ^{x^ - y^) + ^{sgn{x)\xf - sgn{y)\yf) 
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for (i > 2. Compute Ux = x + \x\^ ^, Uy = —y— \y\^ ^- It follows that {ux — 
y) - {uy + x) = |a;|^-i + \y\'^-'^. So S{u) c {\x\l^-^ + \y\l^-^ = 0}, and hence S{u) 
= {(0,0)}. This means that (0,0) is an isolated singular point. Compute Uxx = 
1 + (/3 — l)sgn{x)\x\l^~'^ , Uxy = and Uyy = — 1 — (/? — l)sgn{y)\y\^~'^ . It is easy to 
see that \uxx\ < /3 and \uyy\ < (3 for \x\ < 1, \y\ < 1. So by (2.10) we can estimate 

+ Ky\ ^ 13 + 13 ^ ^ 1 



H < ' < ^ < C 



D - (|a;|/3-i + |y|/5-i)/x/2 - r^-^ 



near (0, 0) where r = \/ x'^ + y"^. In the second inequality above, we have used the 
following estimate 



X) 



= {ux - yf + {uy + xf = {x + \x\^-^ - yf + {-y - \yf-' + 
>l{\xf-' + \yf-'f 

(by 2(a^ + 6^) > (a — 6)^). On the other hand, we observe that ^ = ^ \ 
at (0, 0). It follows that dot [/ = at (0, 0). 

According to Theorem B, S{u) may contain some smooth curves, called 
singular curves. We will study the behavior of N{u) near a point of a singular 
curve. First wo show that for a graph t = u{x,y) the p- minimal graph equation 
(pMGE) is rotationally invariant. 

Lemma 3.4. Suppose u G C^. Let x = ax ~ by, y = bx + ay where a^ + b'^ — 1, 
and let u{x,y) = u{x{x,y),y{x,y)). Then divN{u) = divN{u) where div denotes 
the plane divergence with respect to {x,y). 

Proof. First we observe that both Vu (viewed as a row vector) and {—y, x) 
satisfy the following transformation law (for a plane vector): 



Vu = (Vu) 



a —b 
b a 



{-y,x) = {-y,x) 



a —b 
b a 



It follows that N(u) = [V?i + {—y,x)]/D also obeys the same transformation law 
by noting that D is invariant. Then a direct computation shows that divN{u) = 
divN{u). 

Q.E.D. 

Let Vs be a singular curve contained in S{u) for a smooth u (defined on 
a certain domain). Let po € Fg. Suppose there exists a ball B^{po) such that 
Fg ni?e(po) divides B^{po) into two disjoint nonsingular parts (this is true if \H\ < 
Ci near po in view of Theorem B). That is to say, B^{pq)\{Ts n B^{po)) = B+LlB' 
where and B~ are disjoint domains (proper open and connected). 

Proposition 3.5. Suppose we have the situation as described above. Then 
both N{u){p^) = limpgB+^pj, N{u){p) and N{u){pq) = limp^B-^po N{u){p) exist. 
Moreover, N{u){p^) = -Niu)ip^). 

Proof. By Lemma 3.4 we may assume the x-axis past po = {xq, yo) is transverse 
to Tg. Moreover, we may assume either Uxx{xo,yo) ^ or {uxy + l)(a;o,yo) 7^ 
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(Note that in (3.2a) ^ ^ at po. So if Uxx{xo,yo) = 0, then {uxy — l)(a;o, yo) — 0. 
It follows that (/i,,.y + l)(xo, 2/o) = 2 0). Let TsC] {y = c} = {{xc, c)} for c close 
to yo- Since {xc, c) GTg, we have {uy + x){xc, c) = and (w^ — y){xc, c) = 0. So if 
Uxx{xo,yo) 7^ 0, we compute 

^ (m^ + a:)(a:,c) ^ (m^ + x){x, c) - (u^ + x){x,, c) 
{ux-y){x,c) {ux - y){x,c) - [ux - y){xc,c) 
^ {x-Xc){uxy + l)(a;c,c) 

(*^ Xc^Uxx{x'^^ c) 

(for a;^ , x^ between Xc and a; by the mean value theorem) 

^ {Uxy + l){xl,c) 

Letting (a;, c) go to (a;o,j/o) in (3.7), we obtain 

(3.8) lim '^y±^ = '^Ey±l(po) ^ lim 

pes+^Po Ux — y Uxx peB-^po Ux — y 

Therefore by (3.8) two limits of the unit vector N{u) = (ux — y, Uy + x)D~^ from 
both sides exist, and their values can only be different by a sign. That is to say, 



(3.9) N{u){p+) = ±N{u){p^). 

Now we observe that {ux - y){x,yo) - {ux - y)ixo,yo) = Uxx{'n,yo){x - x^) for 
some 77 between xq and x. Since (ux- y){xo,yQ) 0, {ux-y){x,yo) and Uxx{xo,yo) 
have the same (different, respectively) sign for x > xq {x < Xq, respectively) and 
X being close enough to xq- Thus we should have the negative sign in (3.9). We 
are done. In case Uxx{xo,yo) = 0, we have {uxy + l)(.xo,?yo) 7^ 0. So wc compute 
feSfM i-t^^d °f fe^' get ^(po) instead of ^(p,) in (3.8). 
Then we still conclude (3.9). Instead of {ux—y){x, yo), we consider {uy+x){x, yo). A 
similar argument as above shows that {uy + x){x, yo) will have the same (different, 
respectively) sign as {uxy + l)(.xo, yo) for x > xq {x < xq, respectively) and x being 
close enough to xq- So we still take the negative sign in (3.9). 

Q.E.D. 



Note that we do not assume any condition on H in Proposition 3.5. We will 
study how two characteristic curves meet at a point of a singular curve. We say a 
characteristic curve F c or B~ touches Fg at po if Po S F, the closure of F in 
the .Ty-plane, and touches transversally if, furthermore, po is the only intersection 
point of the tangent line of at po and the tangent line of F at po (which makes 
sense in view of Proposition 3.5). 



Corollary 3.6. Suppose we have the same assumptions as in Proposition 3.5. 
Then there is a unique characteristic curve F+ c touching Fg at po transversally 

(with N-^{u){pq) being the tangent vector of f+ at po). Similarly there exists a 
unique characteristic curve F_ C B~ touching Tg also at po so that r_ U {po} UF+ 
forms a smooth curve in B^{po). 
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First note that we can change the sign of N-^{u) if necessary to make a 
characteristic (i.e. tangent to integral curves of N-^{u) where N-^{u) is defined) 
vector field 7V^(7/) in B^{pq) in view of Proposition 3.5. So f + of any characteristic 
curve r_|_ C S+ touching Tg at Pq must have the tangent vector N-^(u){pq) at 
po. To show the uniqueness of r+ and the transversaUty of N-^{u){pq) to Fg in 
Corollary 3.6, we observe that 

Lemma 3.7. Suppose we have the same assumptions as in Proposition 3.5. 
Then there hold 

(1) N^iu){p+)U{po)=0, 

(2) {c,d)U^{po) = 

for a nonzero vector (c,d) tangent to Tg at po, where we view N-^{u){pq) as a 
row vector and denotes the transpose of U. 

Proof. Let {x{s),y{s)) describe F^ so that po = {x{0),y{0)) and {x' (0) , y' (0)) = 
(c, d). Since u^; — ?/ = 0, + a; = on F^, we differentiate these two equations to 
get (3.2a) and (3.2b) along F^ by the chain rule. At s = 0, we obtain (2). From 
the proof of Proposition 3.5, we learn that N{u){pq) is proportional to {uxx, u-xy + 
l)(po) (if this is not a zero vector). A similar argument (L'Hopital's rule in the 
y-direction) shows that N{u){pq) is also proportional to {uxy — l,Uyy){po) (if this 
is not a zero vector). Therefore N-^{u){pq) is perpendicular to {uxx,Uxy + l)(po) 
and {uxy — l,Uyy){pQ), hence (1) follows. 

Q.E.D. 

We will give a proof of Corollary 3.6 after the proof of Theorem 3.10. 

Remark. If u is not of class C^, the extension theorem (Corollary 3.6) may fail 
as the following example shows. Consider the function 



u{x,y) = I __,_L„,2 



xy, y>0 
xy + y^ cot y <0 



where < i? < |. There holds 



(0,1), y>0 
(cosz?, sint?), y < 0. 

Note that the function u is of class C^'^ on i?^ and satisfies divN{u) = in R^\{y = 
0} where u is of class C^. 

Next we want to analyze the configuration of characteristic curves near an iso- 
lated singularity. First observe that for a smooth u defined on a domain fl, 
characteristic curves are also the integral curves of the smooth vector field 
N-^D = {uy + x, —Ux + y) which vanishes at singular points. We think of N^D as 
a mapping: d E? ^ E?,so that the differential d{N^D)p^: E? E? is defined 
for Po € ^■ 

Lemma 3.8. Let u G C'^{Q). Suppose \H\ = o(i) (Uttlc "o") near an isolated 
singular point po £ ^ where r{p) = \p — po\. Then d{N-^D)pg is the identity linear 
transformation and the index of N^D at the isolated zero po is +1. Moreover, 



Proof. In view of (2.10), we write H = D ^P{u) where 
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(3.10) 



P{u) = {uy + xfu^^ - 2{uy + x){u^ - y)uxy + {u^ - ijf 



Let p- po ^ {Ax, Ay), r = r{p) = |p - po\ = [(Aa;)^ + (Ay)2]i/2_ Noting that 
{uy + x){po) = {ux—y){po) = by the definition of a singular point, we can express 



(3.11) {uy +x){p) = {uyx + l)(po) A X + Uyy{pn) A J/ + o(r), 

(3.12) {ux - y){p) = u^xipo) Ax+ (uxy - l)(po) Ay + o{r) 

forpnearpo- Let a = (%a; + l)(po), b = Uyy{po), c = Uxxipo), and d = {uxy-l)ipo)- 
Substituting (3.11) and (3.12) in (3.10), we compute the highest order term: 

(3.13) 

P(m) = (aAx + bA yfc 

- {a A X + b A y){c A X + d A y){a + d) + {c A x + d A yfb + o{r^) 

c a f Ax 
d b \ \ Ay 

On the other hand, substituting (3.11), (3.12) into = [{Ux-y)'^ + {Uy+xff/'^, 
we obtain 



{bc-ad){{ Ax Ay ) 



} + o{r') 



(3.14) 



Ax 
Ay 



|3 +o(r3). 



Note that be — ad = det U{po) ^ by Theorem 3.3. Letting Ay = and assuming 
c ^ 0, we estimate the highest order term oi H = D~^P{u) : 



{bc-ad)c{AxY 



{bc-ad)c{Axf 



[be — ad)c 



[(o2+c2)(Aa;)2]3/2 [a? + c^]m{Axf \a? + c^fl-^Ax' 
The assumption \H\ = o(i) forces c = 0. On the other hand, letting Aa; = will 
force 6 = by a similar argument. Now we can write 



H : 



-ad{a + d) A X Ay 
d2(Ay)2]3/; 



+ o{-) 



[a2(Ax)2 - 

It follows from the assumption \H\ = o(i) again that a + d = (note that ad = 
ad~bc— — det U (pq) ^ 0). We have proved that Uxx(Po) = c = 0, Uyy{po) = 6 = 0, 



0. Therefore in matrix form. 

1 V 



d{N-^D) 



'^xx 



yy 



^xy 







■ 1 


" 


1 







1 



Note that det(d(A^-^£))pJ = 1 > 0. So the index of N^D at po is +1 (see, e.g., 
Lemma 5 in Section 6 in [Mil]). 

Q.E.D. 

Lemma 3.9. Let u G C^(0). Suppose \H\ = o(^) (little "o") near an isolated 

singular point pq Q where r(p) = \p — po\- Then there exists a small neighborhood 
V C of Po such that the characteristic curve past a point in V\{po} reaches po 
(towards the —N-^ direction) in finite unit-speed parameter. 
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Proof. Write p — po = (Aa;, Ay) = (r cos tp, r sin <p) in polar coordinates. At p, 
we express 



(3.15) N'^ = a(cos<^, siniyj) sini^, cosiy?) 
where 

(3.16) a = A''"'" • (cosiy3,sin(p), /3 = A""" • (— sincp, cos v?). 
Noting that Uxx = u^y = Uyy = at po by Lemma 3.8, we obtain that 

(3.17) Uy+x = Ax + o{r), -u^ + y = Ay + o{r) 

near po by (3.11) and (3.12). It follows that D = [{Ax)^ + (Ay)"^]^/^ + o(r) = 
r+o(r) ncarpo. From this and (3.17), wc can estimate N-^ = (^+o(l), ^+o(l)). 
Substituting this and (cos (p, sin (p) = (^, ^) in (3.16) gives 

(3.18) a=(^^l!±(^+ 0(1)^1 + 0(1). 

Now let {x{s),y{s)) describe a characteristic curve in the —N-^ direction, i.e., 
=-N^.We compute 

d{x{s),y{s)) d{r{s) cos <fi{s), r{s) sin <p(s)) 

ds ds 

dr , . . dip . . . 

= — (cos<^,sm<^) + r—[— smip,cosip). 

Uo (liO 

Comparing with (3.15), we obtain 

Observe that a tends to 1 as r goes to by (3.18) (hence /3 = o(l) since a^+/3^ = 1). 
So from (3.19) we can find a small neighborhood V of po so that the distance 
between po and the characteristic curve F past a point pi G V\{po} is decreasing 
towards the —N-^ direction. Let s denote a unit-speed parameter of F and pi = 
F(si). Then from the following formula 

dr r 
r(s) — r(si) = / -i-c?s = / {—ajds, 



we learn that r(s) reaches for a finite s. 

Q.E.D. 

Let Br{po) = {p^^\\p-po\< r}. Define HM{r) = maXp^oBripo) \H{p)\- 

Theorem 3.10. Let u e C^iQ). Suppose \H\ = o(i) (little "o") near an isolated 
singular point po € where r{p) = |p — po|. Moreover, suppose there is ro > such 
that 
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(3.20) / 

Jo 



HM{r)dr < oo. 



Then for any unit tangent vector v at po, there exists a unique characteristic curve 
r touching po (i.e. po G F, the closure of T) such that N^{u){pq), the hmit of 
N-^{u) at pq along F, equals v. Moreover, there exists a neighborhood V of po such 
that V\{po} is contained in the union of all such T's. 

Proof. Take i5 > small enough so that all characteristic curves past points on 
dBs{po) reach Po in finite unit-speed parameter in view of Lemma 3.9. Let F denote 
the characteristic curve past a point pi G dBs{po). Let (so,si] be the interval of 
unit-speed paramater describing points of F between po and pi . Take a sequence of 
points p j € F — > Pq with parameter Sj — > so- We compute 

eipj) - e{pk) = — = - / Hds 

by (2.23) (recall that 9 is defined by iV = N{u) = (cos 6*, sin 6*)). It follows from 
^ ^ -1 as s ^ So or r ^ and (3.20) that 

ds n 

\d{Pj) - 0{Pk)\ < / HM{r)\ — \dr < 2 / HMir)dr ^ 

as Pj.pk Po- This means that {0{pj)} is a Cauchy sequence. Therefore it con- 
verges to some number, denoted as 0{po',Pi)- Define a map "if : dBg{po) by 
^{q) = 0{po; q). We claim that ^ is a homeomorphism. Take a sequence of points 
Qj G dBs{pf)) converging to q. We want to show that 9{po; qj) converges to 9{pq; q). 
Without loss of generality, we may assume all q'jS are sitting on one side of q so 
that ifi{qi) > (^(92) > ... > ip{q) where cp is the angle in polar coordinates centered 
at Po ranging in [0, 27r). Observe that 



(3.21) 9{po; qj) > 9{po; g,+i) > ... > 9{po; q) 

(letting 9 take values in [0, 27r)) 

for j large since two distinct characteristic curves can not intersect in Bs{po)\{po}. 
Let 6 be the limit of 0{po;qj) as j — » 00. Now suppose 6 ^ 6{po',q) (hence 6 > 
9{pa;q)). Let Tj (F, resp.) denote the characteristic curve connecting qj (q, resp.) 
and Po- Then we can find two rays emitting from po with angle smaller than 9 — 
^(Po; q) and a small positive ^ < ^ so that Tj and F do not meet a fan-shaped 
region D, surrounded by these two rays and dB^^po) for j large. Take a point p G 
n. Consider the characteristic curve F past p. Then F must intersect dBs{po) at a 
point q while reaching po with 9 = 9{po;q). Since F does not intersect with any Tj, 
we have ^(po; qj) > 0{po; q) for large j. On the other hand, q must coincide with q 
for the same reason. So F = F, an obvious contradiction. Thus 6 = 6{po;q)- We 
have proved the continuity of 

Next we claim that ^ is surjective. If not, S^\^{dBs{po)) is a nonempty open 
set. Then by a similar fan-shaped region argument as shown above, we can reach 
a contradiction. Let Fi, F2 be two characteristic curves past qi, q2 G dBs{po) 
touching Po with 6{po;qi) = ^(po; 92)- We want to show that g'l =92- Suppose qi 7^ 
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q-i- So Fi and r2 are distinct (with empty intersection in Bs{po)\{po}) and tangent 
at pq. Let Q,r denote the smaUer domain, surrounded by Fi, F2, and dBr{po) for 
small r > 0. Then is contained in a fan-shaped region with vertex po and angle 
6r such that 6r ^ as r ^ 0. Let F^. = d^r H dBr{po)- It follows that 



(3.22) \Tr\ < rOr 

where jF,. | denotes the length of the arc F^. Since N-^{u) is perpendicular to the 
unit outward normal 1/ (= ±iV(w)) on Fi and F2, we obtain 

(3.23) g{r) = f {uy + x, -u^ + y) ■ vds = {uy + x, -Ux + y) ■ vds. 

Observing that {uy + x, —Ux + y) = P — Po + o{r) by (3.17) and v = on F^, 

we deduce from (3.23) that 



(3.24) g{r) = [r + o{r)]\Tr\ 

On the other hand, the divergence theorem tells us that 



(3.25) 9{r)= I I [{uy + x)x + {-Ux +y)y]dx Ady 



= 2 [ [ dxAdy = 2 [ \T^\dT. 

J JUr Jo 



It follows from (3.25) that g'{r) = 2\Tr\. Comparing this with (3.24), we obtain 
= ^ + o(^). Therefore g{r) = cr^ + o(r^) for some constant c > 0. However, 

inserting (3.22) into (3.24) shows that g(r) = o(r^), i.e., — > as r — !■ 0. We have 
reached a contradiction. So qi = 52 and hence \E' is injective. Next we will show 
that is continuous. Suppose this is not true. Then we can find a sequence 
of qj € dBs{pQ) converging to q ^ q while 9{pQ:qj) converges to 0{po;q) (may 
assume monotonicity (3.21) or reverse order for large j). Take a point q G dBs{po), 
q ^ q and q ^ q, such that 9{po;qj) > d{po;q) > 0{pQ;q) for all large j. Since 
lim0(po; qj) = 0{po] q), we must have 0{pq: q) = 9(pq: q) contradicting the injectivity 
of 4*. Altogether we have shown that 4* is a homeomorphism. The theorem follows 
from this fact. 

Q.E.D. 



Proof of Corollary 3.6: 

Let N-^{p^) denote N-^{'u){p'^) for simplicity. First we claim that N-^{p^) can 
not be tangent to Fg at po- If yt;s, wo have N'^{pq) {U{po) — U'^ {pa)) = by 

Lemma 3.7 (1), (2). However, [/ - f/^ = ^ ^ "q^ ) ■ I* follows that N^{p+) = 0, 

a contradiction. So N-^{pq) is transversal to Fg, and N-^{pq)U^ [po) ^ 0. In fact, 
we have 



(3.26) 



\N^{pt)U^(p<,)\=2 
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by noting that the unit- length vector N^{pq) is proportional to {Uxy + 1, —Uxx) (if 
7^ 0) and {Uyy, —Uxy + 1) (if 7^ 0) from the proof of Lemma 3.7 or Proposition 3.5. 
Now suppose r_|_ and are two distinct (never intersect in B^(po)\{pq} for some 
small e) characteristic curves contained in touching pq (hence with the same 
tangent vector N-^{pq ) at po)- ^ct denote the domain, surromided by r_|_, T'_^_, 
and dBr{pa) for < r < e. Then is contained in a fan-sliapc;d region with vertex 
Po and angle 6r such that ^ as r ^ 0. Let F,. = dilr fl dBr{po)- Then (3.22) 
holds. 

On the other hand, {ux — y,Uy + x) = {Ax,Ay)U'^(po) + o{r'^) by (3.11) and 
(3.12) while (Aa;, Ay) = rN^{p'^) + o(r) and u = (Ax, Ay)r"^ on F^ tends to 
N-^{Pq) as r — > 0. So from (3.23) we compute 

(3.27) g{r) = J {uy + x, -Ux + y) ■ yds 

= j DN^-uds 
= {2r + o{r))\Tr\. 

Here we have used (3.26) in the last equality. Now a similar argument as in the proof 
of Theorem 3.10 by comparing (3.25) with (3.27) gives g{r) = cr+o{r) for a positive 
constant c. However, substituting (3.22) into (3.27) shows that g{r) = o(r^). We 
have reached a contradiction. Therefore F+ must coincide with F'^. Similarly 
we have a unique characteristic curve F_ C B^ touching Tg also at po so that 
r_ U {po} U r+ forms a smooth curve in B^{po). 

Q.E.D. 

The line integral in (3.23) has a geometric interpretation. Recall that the stan- 
dard contact form in the Heisenberg group Hi is Qq = dz + xdy — ydx. Let u 
denote the map: {x, y) {x, y, u{x, y)). It is easy to see that u*0o = {uy + x)dy — 
{y — Ux)dx. Now it is clear that the line integral in (3.23) is exactly the line integral 
of M*0o. Note that 1**60 vanishes along any characteristic curve. If we remove the 
condition (3.20) in Theorem 3.10, 0{po;p\) will not exist as shown in the following 
example. 

Exeimple. Let po = (0,0). Let u = — 13^7^ (= at po) where r'^ = x'^ + y^. 
Write u = /{r"^). A direct computation shows that 



(3.28) Ux = 2xf'{r^), Uy = 2yf{r^), 

(3.29) D = rVl + 4(/')2, 

(3.30) Uxx = 2/' + 4a;2/", Uxy - Axyf", Uyy = 2/' + V/"- 

It is easy to see that po is an isolated singularity (for a general /). Also u is at po 
and Uxx = Uxy = Uyy = at po (for f{t) — — i^jj, t = r"^). Therefore d( A''-'- D)^^ is the 
identity transformation and the index of N-^D is -|-1. Noting that (— sin ip, cos ip) = 
{—y,x)r~^, we compute /? = D~^r~^{uy,—Ux) ■ {—y,x) = ~2f' / yj\ + ^(f'Y by 
(3.16), (3.28), and (3.29). Therefore along a characteristic curve reaching po in the 
—N-^ direction, we can estimate 
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(3.31) ^ = (by (3.19)) 



2/' 



r^Jl + A{f'Y -rlogr2 
as r for f{t) = -r^, t = r^. Since ^ ^ -1 by (3.18) and 



2 , 

rdr = oo, 



Q — rlogr^ 

we conclude from (3.31) that (p — > oo, hence 9 ^ oo an the point on the character- 
istic curve approaches po (Observing that a ^ 1 and /? ^ in (3.15) as r ^ 0, we 
have the limit of 9 equal to the limit of (fi plus 7r/2 if one of the limits exists, hence 
another limit exists too). 

Next substituting (3.28) and (3.30) into (3.10) gives 

(3.32) P{u) = 2r^[f + 4{f'f + 2r^f"]. 

By (2.10), (3.29), and (3.32), we obtain the p-mean curvature 

r(l+4(/02)3/2 • 

For f{t) = -Is|t,^ = r■^/'«-l^, 2rV" ~ near r = 0. Inserting these 

estimates into (3.33) gives H ~ ~ riogr ' ^'^^ ^ straightforward computation 
to verify that H = o(^) and the integral in (3.20) for such an H diverges. 



4. A Bernstein-type theorem and properly embedded p-minimal 

surfaces 

Recall that the characteristic curves for a p-minimal surface S in a pseudoher- 
mitian 3-manifold M are Legendrian geodesies in M by (2.1). For M = Hi, we 
have 

Proposition 4.1. The Legendrian geodesies in Hi, identified with R^, with 
respect to \/p-^- are straight Unes. 

Proof. Write a unit Legendrian vector field ei = fei + ge2 with + = 1. 
Since V^'* ei = VP'' e2 = 0, the geodesic equation Vf^'^ ei = implies that eif = 
eig = 0. This means that f ^ ci,g = C2 for some constants Ci,C2 along a geodesic 
r (integral curve) of ei. We compute 

(4.1) ei = ciei + 0262 = ci{dx + ydz) + C2{dy - xdz) 

= cidx + C2dy + {ay - C2x)dz. 

So r is described by the following system of ordinary differential equations: 
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(4^2.) - = c„ 

,4.2b) |.., 

(4.2c) —=ciy- C2X. 

By (4.2a), (4.26) we get x = cis + di,y = C2S + d2 for some constants di,d2. 
Substituting into (4.2c) gives z = (cirf2 — C2rfi)s + ds for some constant ds. So F is 
a straight line in R^. 

Q.E.D. 



Corollary 4.2. The characteristic curves of a p-minimal surface in Hi are 
straight Unes or line segments. In particular, a characteristic curve (line) of a 
p-minimal surface in Hi past a point q is contained in the contact plane past q. 

Recall that Fa,b = a{ux — y) + b{uy + x) for real constants a, b with a? -\-h^ = 1. 

Lemma 4.3. Suppose u G defines a p-minimal graph near p G S{u), an 
isolated singular point. Then Fa^b = 0, for a, 6 G i?, + &^ = 1, define all 
straight line segments passing through p which are all characteristic curves in a 
neighborhood of p with p deleted. 

Proof. First we claim Vfa,b(p) 7^ for all (a, 6) with + b'^ — 1. If not, there 
exists (ao,6o) such that VFa„^5„(p) = 0. So detU{p) = (see the paragraph after 
(3.1)). It follows from the proof of Theorem B that there is a small neighborhood of 
p which intersects with S{u) in exactly a smooth curve past p. This contradicts 
p being an isolated singular point. We have shown that WFafi{p) 7^ for all (a, b) 
with + &^ — 1. Therefore Fafi = defines a smooth curve past p for all (a, b). 

In a neighborhood of p with p deleted, we observe that Fa.bD~^ = suiOq cos0 — 
cos^osin^?. Here wc write a = sin (?o, = — cos ^^o• Recall that {ux~y)D^^ = cos9, 
[uy + .x)Z)^^ = sm6 (see Section 2). So 9 — on {Fa,b = 0}, and hence by 
(2.186) N-^ = {sin9, — cos9) = (sin 6*0, — cos6'o) is a constant unit vector field along 
{Fa^b = 0}. On the other hand, V(Fa,fe£)-i) = (-asin6l + 60086*)^^^ is parallel to 
TV = (cos 9, sin 9) since N-^ ■ ^9 = is our equation. It follows that {Fa.b = 0} is a 
straight line segment and an integral curve of iV^ in a p-deleted neighborhood. 

Q.E.D. 

We remark that Lemma 4.3 provides a more precise description of Theorem 3.10 
in the case of = 0. 

Since the characteristic curves are straight lines, we will often call them charac- 
teristic lines (line segments). From Corollary 3.6, we know that a characteristic line 
keeps straight after it goes through a singular curve. Note that two characteristic 
line segments Fi, F2 can not touch a singular curve at the same point po unless they 
lie on a straight line by Proposition 3.5 (the limits of N{u) at po along Fi, F2 must 
be either the same or different by a sign). We say a graph is entire if it is defined 
on the whole xy-plane. 

Lemma 4.4. Suppose u G defines an entire p-minimal graph. Then S{u) 
contains no more than one isolated singular point. 
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Proof. Suppose we have two such points pi,P2 G S{u). Then there exist two 
distinct straight hnes passing through pi,p2, respectively and intersecting at a 
third point q such that q ^ S{u) in view of Theorem B and Corollary 3.6. From the 
proof of Lemma 4.3 and Corollary 3.6, these two straight lines are characteristic 
curves in the complement of S{u), namely integral curves of N-^{u). But then at q, 
N-^{u) has two values, a contradiction. 

Q.E.D. 

On the other hand, remember that we can change the sign of A^-'- (u) if necessary 
to make a C° characteristic (i.e. tangent to integral curves of N'^{u) where N-^{u) 
is defined) vector field N-^{u) on the whole xy-plane except possibly one isolated 
singular point in view of Proposition 3.5. Moreover, we have a unique characteristic 
curve "going through" a point of a singular curve by Corollary 3.6. So we can 
conclude that the following result holds. 

Lemma 4.5. Suppose u G dcGncs an entire p-minimal graph and S{u) con- 
tains no isolated singular point. Then all integral curves (restrict to characteristic 
lines of N-^ (u) ) of N-^ (u) are parallel. 

Proof of Theorem A : 

According to Lemma 4.4, we have the following two cases. 

Case 1. S{u) contains one isolated singular point. 

In this case, we claim the solution u is nothing but (1.1). Let po be the singular 
point. Let r, •& denote the polar coordinates with center po- We can write ±N-^ (u) = 
in view of Lemma 4.3. By (2.20) we have the equation 

(4.3) urr=g^ = 

defined on the whole .xy-plane except po- It follows from (4.3) that u = rf{'d)+g{'d) 
for some functions f,g in Since u is continuous at po = {xo,yo) (where 
r = 0), u{xo,yo) = gii^) for all i?. So 5 is a constant function, say g = c. Also 
/(1?) = f{'d + 27r) implies that we can write /(■!?) ~ /(cos i?, sin i9) where / is 
in a = cosd and /3 = sin??. Compute Ux = u^Vx + u-odx = af + P'^fa — oiPffi in 
which fa = df /da, = df /dp , etc. and we have used = — (sin^?)/r. Similarly 
we obtain Uy = (3f + a^ffj — a^fa- Since and Uy are continuous at (a;o, yo), we 
immediately have the following identities: 

(4.4) - + a~f = a 

(4.5) - apU + o?h + Pf = b 

for all a, p. Here a = Ux{xo,yo),b = Uy{xo,yo). Multiplying (4.4), (4.5) by a, /3, 
respectively and adding the resulting identities, we obtain [a^ + /3^)/ = aa + bp. 
It follows that f = aa + bp since + = 1. We have shown that u{x,y) = 
r{a cos 1? + 6 sin ■&) + c = a{x — xq) + b{y — yo) + cq = ax + by + {c — axo — byo) = 
ax + by + c. (In fact (xq, yo) = {—b, a) from the definition of a singular point and 
the plane {{x,y,u(x,y)} is just the contact plane passing through {xo,yo)). Wc 
can also give a geometric proof for Case 1 as follows. Let ^0 denote the standard 
contact bundle over Hi (see the Appendix). Let S denote the p-minimal surface 
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defined by u. Observe that the union of all characteristic lines "going through" poj 
the isolated singular point, (together with po) constitutes the contact plane ^o(po) 
in view of Corollary 4.2 and Lemma 4.3. It follows that ^o(po) C S. So S = ^o(po), 
an entire plane, since S is also an entire graph. We are done. 
Case 2. S{u) contains no isolated singular point. 

In this case we claim u is nothing but (1.2). By Lemma 4.5 and Lemma 3.4 we 
can find a rotation x = ax + by, y = —bx + ay with + 6^ = 1 such that 



By (2.20) our equation reads Uxx = where u{x,y) = u{x,y). It follows that 



for some smooth fimctions f,g. From (4.6) wc know N{u) = (0,±1). By the 
definition of N{u) we obtain mj— y = 0. So f{y) = y. Substituting this into (4.7) 
gives u = xy + g{y), and hence u = —ahx^ + (a^ — h'^)xy + aby"^ + g{—bx + ay). 



We remark that the singular curve in Case 2 is defined by a; = —g'{y)/2, and 
this curve has only one connected component. 

Next we will describe a general properly embedded p-minimal surface in Hi, 
which may not be a graph. According to Proposition 4.1, such a surface must be 
a properly embedded ruled surface with Legendrian (tangent to contact planes) 
rulings when we view Hi as R^. We call a ruled surface with Legendrian rulings a 
Legendrian ruled surface. Conversely, we claim that a properly embedded Legen- 
drian ruled surface is a properly embedded p-minimal surface. First observe that 
a straight line L past po — {xo,yo,zo) pointing in a contact direction Ciei(po) + 
C2e2(po)i cf + C2 = 1: is tangent to the contact plane everywhere. Here ei(po) 
= dx + yodz or (1,0, yo) and e2(po) = dy - xod^ or (0,1, -a;o). In fact we can 
parametrize any point p = {x, y,z) G L as follows: 

(4.8) {x, y, z) = {xo, yo, zo) + s[ciei{po) + 0262(^0)] 

for some s G R. The tangent vector at p is just ciei(po) + C2e2(po) which exactly 
equals ciei{p) + 0262(2?) by a simple computation. So it is a vector in the contact 
plane at p. And L is a Legendrian line. A Legendrian ruled surface is generated 
by such Legendrian lines with its characteristic field ei(p) = ciei(po) + 6262 (po) 
= ciCiip) + C2e2{p) with ci,C2 being constant along the characteristic line (or line 
segment) past a nonsingular point p. It follows that Vf ''' ei = ci Vf •'' ei + C2 Vf ■^ 62 
= since WP'^'ij = 0, j = 1,2. By (2.1) the p-mcan curvature H vanishes. So 
we have shown that a Legendrian ruled surface is a p-minimal surface. Also an 
immersed Legendrian ruled surface is the union of a family of curves of the form 
(4.8), and has the following expression: 



(4.9) {xo{T),y„{T), zo(t)) + .s[sin (?(r)(l, 0,yo(T)) - cos0(t)(O, 1, -.to(t))]. 



Here {xo{T),yo{T), zo(t)) is a curve transverse to rulings, and we have written ci(r) 
= sin^(T) and C2(t) = — cos^(r). 



(4.6) 




(4.7) 



u = xy + g{y) 



Q.E.D. 
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Example. In (4.9) we take 7(t) = {xo{T),yo{T), zo{t)) = (cos r, sin r, 0) and 
9{t) = t, < t < 27r. It is easy to see that ei(r) = (sinr, — cost, 1) (note that ei 
is independent of s). Compute ei(Ti) x ei(r2) • (7(r2) — 7(ti)) = (sinr2 — sinn)^ + 
(cosT2 — cosTi)^. So ei(Ti) X ei(r2) • (7(t2) — 7(ti)) = if and only if n = T2. Now 
it is easy to see that this Legendrian ruled surface is embedded. Let us write down 
the X, y, z components as follows: 

(4.10) x{t, s) = COST + (sin t)s, y(r, s) = sinr — (cos t)s, z{t, s) = s. 

Sodr{x,y,z) = (If, 1^, If) = (- sinr+(cosr)s,cosr+(sinT)s,0) and Qq {dr{x,y,z)) 
= 1 + 7^ 0. This means that the tangent vector dr{x,y,z)) is not annihilated 
by the contact form Oq. Therefore (4.10) defines a properly embedded p-minimal 
surface in Hi with no singular points, which is not a vertical plane (i.e. having the 
equation ax + by = c). In fact, eliminating the parameters r and s in (4.10) gives 
the equation = a;^ + j/^ — 1. 

For a Legendrian ruled surface of graph type, we can have an alternative approach 
to show that it is p-minimal. Let {x,y,u{x,y)) describe such a Legendrian ruled 
surface. Suppose we can take x as the parameter of the rulings (straight lines) for 
simplicity. Then (f /dx'^{u{x,y{x))} = along a ruling. By the chain rule we have 

(4.11) r + 2sa + ta'^ = 

where a = = Uxx, s = Uxy, and t = Uyy. On the other hand, along a Legendrian 
line, we have the contact form dz + xdy — ydx = 0. It follows that ^ + xa — y 
= p + qa + xa — y = where p = u^, q = Uy. So a = — {if q + x = 0, then 
p — y = 0). Substituting this into (4.11) gives 

{q + xfr - 2{q + x){p - y)s + {p - yft = 

which is exactly (pMGE) . We remark that a general ruled surface satisfies a third 
order partial differential equation (see page 225 in [Mo]. Solving (4.11) for "a" in 
terms of r,s,t, and substituting the result into d^/dx^{u{x,y{x))} = give such 
an equation). 



5. Compeirison principle and uniqueness for the Dirichlet problem 

Let be a domain (connected and proper open subset) in the xy-plane. Let u, v : 
— > i? be two functions. Recall the singular set S{u) = {{x,y) e fl \ Ux — y = 0, 

Uy + X = 0} and N(u) = [Vu + {-y,x)]D:^^ where I?„ = y/ {ux - yY + {uy + x)"^ 

(e.g. see (2.15a)). 

Lemma 5.1. Suppose we have the situation described above. Then the equahty 

(5.1) (Vm - Vv) ■ {N{u) - N{v)) ^ ^" I N{u) - N{v) p 

holds on n\{S{u) U S{v)). In particular, (Vw - Vv) ■ (7V(m) - N{v)) = if and only 
if N{u) = N{v). 
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Proof. Let a = Vu + {-y,x), j3 = Vv + {-y,x). Noting that N{u) = |||, 
N{v) = (D„ = \a\, = |/3|), we compute 

(5.2) (Vn - V^) • {N{u) N{v)) = (d - /3) . ( il - A) 

= |a| + - ^ - ^ = + - cosi?) 
in which cosi? = , . On the other hand, we compute I N(u) — N(v) P = I 

|a;||/3| 

||| - ill P = 2 - 2||iiC| = 2(1 - C0S1?). Substituting this into the right-hand side 
of (5.2) gives (5.1). 

Q.E.D. 

Remark. For the prescribed mean curvature equation divTu = H in where 
Tu = I ^" , we have the following structural inequality: 

y l+|VtiP 



(V. - V.) . (T. - T.) > ^I±m±_^II±^\Tu - T.\- 
> \Tu-Tvf. 

The above inequahty was discovered by Miklyukov [Mik] , Hwang [Hwl] , and CoUin- 
Krust [CK] independently. Here we have adopted Hwang's method to prove Lemma 
5.1. 

Next let u € C°{fl\Si), V € C°(r2\S'2), i.e., u,v are not defined (may blow up) 
on sets 5*1, S'2 C fl, respectively. Let S = Si[JS2^S{u)[JS{v) where S{u) C i^\Si, 
S{v) C n\S2. 

Theorem 5.2. Suppose Q is a bounded domain in the xy-planc and Hi{S), 
the l-dimensional Hausdorff measure of S, vanishes. Let u & C° {^\Si )riC^{Q\S), 
V e C0(n\S'2) n C2(0\6') such that 



(5.3) divN{u) > divN{v) in rL\S, 

(5.4) u<v on dVL\S. 

Then N(u) = N{v) in n+\S where n+ = {p G n \ u{p) - v{p) > 0}. 

Proof. First HiiS) = means that given any e > 0, we can find countably many 
balls Bj ,:, j = 1,2, ... such that S C Uj^^iJj^e and T,j±-^length{dBj^^) < e and we 
can arrange U°^2-^i,ei C Uj^iBj^^^ for ei < €2- Since S is compact, we can find 
finitely many Bj^^'s, say j = 1,2, ...,n(e), still covering S. Suppose 0+ 7^ 0. Then 
by Sard's theorem there exists a sequence of positive number Si converging to as 
i goes to infinity, such that = {p € | u{p) — v{p) > 5i} ^ ^ and drtf\S is 
smooth. Note that dflf fl dfl C S by (5.4). Now we consider 

li = (f tan-\u - v){N{u) - N{v)) ■ vds 

ia(a+\u;l\'s,,,) 
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where i/, s denote the outward unit normal vector and the arc length parameter, 
respectively. By the divergence theorem we have 



(5.5) Ii=[ [ { .^/ {Vu-Vv)-{N{u)-N{v))+ 

tan"^(M - v)div{N{u) - N{v))}dxdy. 

Observe that the second term in the right hand side of (5.5) is nonnegative by 
(5.3). It follows from (5.1) and (5.5) that 

On the other hand, we can estimate 

(5.7) li < (tan-i Si) [ {N{u) - N{v)) ■ vds 

Jdn+\(vjfJlB,,,) 

+ ^ • 2 • Yl'^MlengthidBj e) < tt • 'Lf^-^length{dBj ,) < 7re 

by noting that v = - | v("I") | and hence {N{u) - N{v)) ■ u < by (5.1). If 

N{u) 7^ N{v) at some point p in il~^\S, then N{u) ^ N{v) in an open neighborhood 
V of p, contained in fi^ for all large i. Observe that the measure of V\ Bj^^ is 
bounded from below by a positive constant independent of small enough e and i. 
Thus from (5.6) Il> c, & positive constant independent of small enough e and large 
enough i. Letting e go to in (5.7) will give us a contradiction. So N{u) = N{v) 
in f2+\5 and hence in Q'^\S by continuity. 

Q.E.D. 

Remark. Theorem 5.2 is an analogue of Coneus and Finn's general comparison 
principles for the prescribed mean curvature equation (cf. Theorem 6 in [CF]). In 
[Hw2] Hwang invoked the "tan~^" technique to simplify the proof of [CF]. Here we 
have followed the idea of Hwang in [Hw2] to prove Theorem 5.2. 

Lemma 5.3. Let u,v G C'^{Cl) fl C°(0) where O is a bounded domain in the 
xy-plane. Suppose N{u) = N{v) in Q\{S{u) U S{v)), u = v on dfl. Then u = v in 

n. 

Proof. Suppose u ^ v in Q. We may assume the set {p G fl\u{p) > v{p)} ^ 
(otherwise, interchange u and v). By Sard's theorem (e.g., [St], noting that is 
essential), there exists e > such that = {p e | u{p) — v{p) — e > 0} 7^ and 

= {p e O I u{p) —v{p) — e} is smooth. Note that F^ n dVl = since u = v on 
dil by assumption. Also F^ is closed and bounded, hence compact. Therefore F^ is 
the union of (finitely-many) smooth loops. Choose one of them, and denote it 
as F^. We claim 

du dy dx ^ 
ds ^ ds ^ ds 
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on where s is a unit-speed parameter of F^. For p £ V^n S{u), (5.8) holds by 
the definition of a singular point. For p G F^\(5('u) U S{v)), we compute N-^{u)u 
{N-^{u) as an operator acting on u) as follows: 



(5.9) A^-^ iu)u = N' (u) ■ Vu = D-^{{Vu)^ + (x, y)} • Vu 

= D-\x, y) • Vm = D-\x, y) ■ {Vm + {-y, x)} 
= {x,y)-N{u). 

Similarly we can show 

(5.10) N^{v)v = {x,y)- N{v). 

Since N{u) = N{v), hence iV -"-(«) = N-^{v) at p, wc conclude that N-^{u){u — 
u) = at p by (5.9) and (5.10). This means that N^{u) is tangent to at p. So 
(5.8) holds at p. For p e {T[\Siu)) n S{v), f3 {= Vv + (-?;,. x)) = 0. Wc observe 
that d (= V?i + (—y,x)) — a — P = V(m — v). This means that N{u) (= j^y) is 

normal to F^. So again N-^{u) is tangent to F^ at p. Thus (5.8) holds at p. We have 
shown that (5.8) holds for all p G F^. F^ bounds a domain, denoted as O^. Now 
integrating (5.8) over F'^,, we obtain that the area of vanishes by the divergence 
theorem, an obvious contradiction. 

Q.E.D. 

Proof of Theorem C : 

It follows from Theorem 5.2 and Lemma 5.3. 

Q.E.D. 

We can generalize Lemma 5.1 in the following form. Let O be a domain in i?". 

Let u,v : ft ^ R he two fimctions. Let F be a C° vector field in i?". Define 
S{u, F) = {p G n \ Vu + F ^ a.t p} and S{v, F) similarly. 

Lemma 5.1'. On Q\[S{u, F) U S{v, F)], we have the following identity: 

(v« _ V.) . (4 - i) = (M±M) I ^ - 4 |2 

where d = 'Vu + F,0='Vv + F. 

In general a contact form dz+'EjZifjdx^ in gives rise to an F = (/i, /2, fn) 
such that Vm + F is the i?"-projection of the Legendrian normal to the graph 
z = u(x^,.T^, ...,a;"). To generalize Theorem 5.2 to a domain fl in i?" and replace 

N{u), N{v) by |§y, ill , we will use 5^ = 5i U ^2 U S{u, F) U S{v, F) instead of S. 
Theorem 5.2'. Suppose O is a bounded domain in R" and Tin-iiSp) = 0. Let 

u G C^ifiXSi) n C^i^xsp^), V e c°{n\S2) n c^{n\Sp^), and f g c^{n) n c°{n) 

such that 

div( ) > div( ) in fl\Ss, 

\wu+f\'~ V«+^r 
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U < V 



on dfl\Spt. 



Then = ^H±^ ^i^^g n+ ^ {p e O I - ^b) > 0}. 

The proof of Lemma 5.1' (Theorem 5.2', respectively) is similar to that of Lemma 
5.1 (Theorem 5.2, respectively). We can also generalize Lemma 5.3. Let be a 
bounded domain in ii^"*, m > 1. Take two real functions u,v G C^(f2) nC"^(fi). Let 
a = Vu + F where F = (/i, /2, /2m) is a smooth vector field on fl. Define 
F * = (/2, -fijfi, -fa, /2m, -/2m-i). Denote ||| by Np{u) and the set {pen 
\d = 0} hy Sp{u). 

Lemma 5.3'. Suppose we have the situation as described above. Suppose 
Np{u) = Np{v) in n\{Sp{u) U Sp{v)), u = v on dn, and divF* > a.e. in Q. 
Then u = v on CI. 



Proof. Suppose the conclusion is not true. We may assume the set {p £ ^ \ 
u{p) > v{p)} ^ 0. By Sard's theorem we can find a small e > such that Clc = 

{p€n\ u{p) - v(p) - e > 0} ^ and Le = {39 G f7 I u(p) ~ v{p) = e} = dCt^ is 
smooth. Let a* = (uy^, —Ux^jUy^, —Ux2, Uy^, —Ux^) + F *(so that a* ■ a = 0). 
Let V = — |^^"~^?| denote the outward unit normal to F,. We claim 



(5.11) a* -1^ = 

on Fg. Note that a = if and only if a* = 0. So it is obvious that (5.11) holds for 
p e Spin). Let Nt,{u) = ^ for p G n\Sp{u). In case p e T,\{Sp{u) U Sp{v)), we 
can generalize (5.9), (5.10) as follows: 



(5.9') Nt{u)u = F* ■ Np{u), 

(5.10') N*p{'"^v = F* ■ Np{v). 

Since Np{u) = Np{v) by assumption, and hence Nt[u) = Nt^v), we deduce from 
(5.9') and (5.10') that N%(u)(u - v) = 0. So N*Ju) is tangent to F, (at p). This 
implies (5.11). Forp G {T p{u))r\S p{v) , we still have (5.11) by a similar argument 
as in the proof of Lemma 5.3. We have proved (5.11) for all p G F^. Let dA denote 
the volume element of F^, induced from i?^™. Now we compute 

(5.12) = 1 a* ■ udA (by (5.11)) 

div(d*) d{volume) (by the divergence theorem) 



divF* d{volume) > 
by assumption. We have reached a contradiction. 



Q.E.D. 
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We remark that the condition divF* > is essential in Lemma 5.3'. Consider 
the case F = 0. Let Q. = B2 — Bi where Br denotes the open ball of radius r. Let 
^ = /(^)j'i' = Eind f ^ g with the properties that /(I) = 5(1), /(2) = g(2), 

and /' > 0,c/' > for 1 < r < 2. It follows that S^\u) = {Vu = 0} = 
Sp{v) = {Vu = 0} = (p, and Vu = f'{r)Vr, Vv = g'{r)Vr. Therefore we have 

Vu „ Vv 

Vr 



\Vu\ \Vv\ 

by noting that |Vr| = 1. We have constructed a counterexample for the statement 
of Lemma 5.3' if divF* > is not satisfied. 

For F = -?/2, X2, -ym, Xm), we have F* = {xi,yi, X2, t/2, Xm, Vm)- 

In this case, we can view the integrand in (5.12) geometrically: {dxj A dyj means 
deleting dxj A dyj) 

a* ■ vdA = + Xj)dyj + {u^^ - yj)dxj]A 



dxi A dyi A ... A dxj A dyj A ... A dxm A dym 
= [du + T.^jZ^ixjdyj - yjdxj)]A 
C^jZ^dxi A dyi A ... A dxj A dyj A ... A dxm A dym) 



^ e(„)A((ie(„))"-i. 



2'"-i(m- 1)! 



Here Q(m) = du + {xjdyj — yjdxj ) is the standard contact form of the 2m + 1- 
dimensional Heisenberg group, restricted to the hypersurface {{xi,yi, X2,y2, 
Xm, ym, u{xi, yi,X2, 2/2, •-, Xm, ym)} ■ Integrating the above form gives 



1 


2m- 


^(m — 
1 


1)! 


2"!- 


-i(m- 
1 


1)! 


2m- 


"1(to — 


1)! 



2'"m! Volume{n,) = 2m Volume{n^). 

In the last equality, we have used dQ(^m) = '2T,j~^dxj Adyj and hence {d<d(^m))"^ = 
2'^m\dxi A dyi A ... A dXm A dym- Note that divF* = 2m in this case. In general, 
let @p = dz + YPj^^ fjdxj for F = (/i, /2, /2m)- We can easily compute 

dQp, A Y.^~^l\dxi A dx2 A ... A dx2j-i A dx2j A ... A dx2m-i A dx2m) 

= {divF*)dxi A dx2 A ... A dx2m-i A dx2m. 

Note that in case Op = ©(m) (with u, Xj,yj replaced by z, X2j-i,X2j, respectively), 
we have 

(de^)™-i = (de(„))™-i 

= 2™~-^(m — l)!Sj^™(da;i A dx2 A ... A dx2j-i A dx2j A ... A dx2m-i A dx2m)- 
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We can generalize Theorem C to higher dimensions without the condition on the 
singular set. Let N{u) = Npi{u) and S{u) = Sp{u) for F = {—yi,xi, — 1/2, X2, —ym,Xm)- 

Theorem C. For a bounded domain Cl in i?^™, m > 2, let u,v e C^{n)nC" (0) 
satisfy divN{u) > divN{v) in Cl\S and u< v on dCl where S = S{u) U S{v).. Then 
u < V in ft. 

First we observe the following size control of the singular set in general dimen- 
sions. 

Lemma 5.4. Suppose u G C^(f2) where Q C i?^"*. Tiien for any singular point 
p e S{u), there exists an open neighborhood V C ft such that the m-dimensional 
HausdorS measure of S{u) fl V is finite, and hence 'H2m-i{S{u)) = for m > 2. 

Proof. Consider the map G : p £ ^ (Vm + F){p). Computing the differential 
dG of G at a singular point p (where G{p) =0), we obtain 



{Uij) + 






-1 








1 




















-1 








1 






v 



in matrix form, where (uij) is the Hessian. Let {dG)^ denote the transpose of 
dG. It is easy to see that 2m = rank{dG — {dG)^) since Uij = Uji. On the other 
hand, rank{dG - (dG)^) < rank{dG) + rank{-dGY = 2rank{dG). Therefore 
rank{dG) > m. Hence the kernel of dG has dimension < m. It follows by the 
implicit function theorem that there exists an open neighborhood V of p such that 
G~^{0) (IV = S{u) n y is a submanifold of V, having dimension < m. 

Q.E.D. 

Proof of Theorem C: 

Observe that the condition Ti.2m-i{S) = (the dimension n = 2m) in the proof 
of Theorem 5.2 (and Theorem 5.2') can be replaced by the following condition: for 
any subdomain O CC O, i.e., O C fl, H2m-\{0 n 5) = 0. Since S = S{u) U S{v) is 
closed in the compact set O, OC^S = OOS. Now Theorem C follows from Theorem 
5.2' (with the size control condition on S replaced by the above-mentioned one), 
Lemma 5.3', and Lemma 5.4. 

Q.E.D. 



6. Second variation formula and area-minimizing property 

In this section wc will derive the second variation formula for the p-area func- 
tional (2.5) and examine the p-mean curvature H from the viewpoint of calibration 
geometry ([HL]). As a result we can prove the area-minimizing property for a p- 
minimal graph in Hi. 

We follow the notation in Section 2. We assume the surface S is p-minimal. Let 
/, g be functions with compact support away from the singular set and the boundary 
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of S. Recall T denotes the Reeb vector field of G (see Section 2 or the Appendix). 
We compute the second variation of (2.5) in the direction V = fe2 + gT : 

(6.1) 5l I QAe^= I Ll{Q^e^)= j iy o d{iv o d{Q) h e^)) . 

Here wc have used Stokes' theorem and the formula Ly = iyod+doiy and rf^ = 0. 
By (2.7) and H = u){ei), we get 

(6.2) d(e A e^) = -iJ"e A A e^. 

We recall (see Section 2) to define a function a on T,\S-e such that ae2 +T e TS. 
Observe that {ae2 + T, ei} is a basis of T(E\6'e). So on we have 

(6.3) e^Ae}=aeAe\ 

From (6.2) it is easy to see that ivod{QAe^) = gHe^ Ae^ — fH&Ae^. Then taking 
iv o d of this expression and making use of (A.lr), (A.3r), (6.3) and fl" = on S, 
we obtain 

(6.4) IV o d{iv o d{@ A e')} = (ga - f){gT + fe2){H)Q A 

= -{ga- ffe2{H)QAe^ 

on S. For the last equality we have used T{H) = —ae2{H) since ae2 + T G TT, and 
H = on T,. Expanding the left-hand side of (A.5r) gives 

(6.5) e2{H) = 2W + ei(a;(e2)) + 2lu{T) + {00(62))^. 

Here we have used (A.6r) and Lv{ei) = = on S. The surfaces (ft{^\Ss) are the 
level sets of a defining function p. Here ipt = fe2 + gT. It follows that (/e2 + gT) (p) 
= 1. On the other hand, {ae2 + T){p) ~ from the definition of a. So T{p) = 
—ae2{p) and e2{p) = (/ — a.g)~^ (where f — ag ^ 0). Applying (A.6r) and (A.7r) 
to p, and using the above formulas, we obtain 

(6.6a) a;(e2) = /i"^ei(/i) +2a, 

(6.6b) w(T) = Ri (a) - ahr'^ei [h) - ImAn 

where h = f — ag. Now substituting (6.6a), (6.66) into (6.5), we get 

(6.7) e2{H) = 2W- 2ImAii + 4ei{a) + Aa^ 

Observing that ei{ei{h?))e Ae^ = @Ad{ei{h?)) = -d{ei{h?)Q) + 2ei{h?)ae^ AQ 
on S by (A.lr) and (6.3), we integrate \ei{ei{h?)) = (ei(/i))^ + hel{h) to obtain 

/ hel{h)QAe^= [ [{eiihj f + 2ahei{h)]e A e'^ . 

Substituting (6.7) into (6.4) and (6.4) into (6.1) and using the above formula, we 
finally reach the following second variation formula. 
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Proposition 6.1. Suppose the surface E is p-minimal as defined in Section 
2. Let f, g be functions with compact support away from the singular set and the 
boundary of E. Then 



(6.8) 

Js 

= JjM - "fl))' + (/ - agfi-'^W + 2ImAn - 4ei(a) - Aa^]}e A e^. 

Note that the Webster- Tanaka curvature W and the torsion An are geometric; 
quantities of the ambient pseudohermitian 3-manifold M. When the torsion An 
vanishes and W is positive, we can easily discuss the stability of a p-minimal surface 
(see Example 2 in Section 7). If both W and An vanish, e.g. in the case of 
M = Hi (see the Appendix), we can compute a, ei{a) for a graph z = u{x,y) 
as follows. First note that the defining function p = [z — u{x,y))D~^ satisfies 
the condition e2{p) = 1 (recall 62 = —[{ux — y)ei + {uy + x)e2]D~^ in Section 
2). So a = —T{p) = —dp/dz = —D~^ and a direct computation shows (recall 
ei = [—{uy + x)ei + {ux — y)e2]D~^ in Section 2) that 

(6.9) - 4ei(a) - 4q;^ = 4:{{ux - y){uy + x){uxx - Uyy)+ 

[{uy + x)"^ - {ux - yf]uxy}D^'^. 

For example if u = xy, the right-hand side of (6.9) equals l/x^. So away from the 
singular set, the second variation of the p-area is nonnegative according to (6.8) 
(it is easy to see that the second variation in the ei direction always vanishes). 
Note that {x = 0} is the singular set in this example. From the p-area minimizing 
property shown below (Proposition 6.2), we know the second variation of the p- 
area for any p-minimal graph over the xy-plane with no singular points must be 
nonnegative. 

If we consider only the variation in the T direction, i.e., / = 0, we should combine 
the term in (6.9) with terms involving ei(a) in the expansion of {ei{—ag))^ (to get 
a better expression of (6.8)). For instance, take a graph {x,y,u{x,y)) G Hi over a 
domain O in the xy-plane. We denote the energy functional for the p-area by 

E{u) = / Ddx A dy 
Jn 

in view of (2.5) and (2.11). A direct computation shows that ^ |e=o E{u + sv) = 
{ei{v)Y dx /\dy for a variation v = v{x, y). On the other hand, this should be 
obtained from (6.8) by letting / = and g = v (with compact support away from 
the singular set and dCl). It turns out to be equivalent to verifying the following 
integral formula (note that a = —D~^, 9 A = Ddx A dy) 

[ {ei{v^)D-'ei{D-^) + v^[{ei{D-')f + 4D-^ei{D-^) - AD-^]}Ddx Ady = 0. 
Jn 

We leave this verification to the reader (Hint: we need an integration by parts 
formula- / ei{(p)ijjQ A = - J[(pei{ip) + 2(p'tjja]@ A e^. Express D'^ = {ei{a) f + 
(62(0"))^ where a = z — u{x,y). The following formulas: ef (cr) = ei(cr) = 0, 62(17) = 
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D, [61,62] = -25^-62(^)62, 6i(D2) = -4D - 262(0)1)2, and el{D^) = 2{ei{D))^ + 
462(0)0 + 4{e2{e)Df are useful). 

For later use, we deduce a different expression for S = [— 2W+2ImAii — 46i(a) — 
Aa'^]@ A in (6.8). Noting that A 6 = on E, we can easily get 

(6.10) d{a&) = [-ei{a) - 2a'^]e A 

by (A.lr) and (6.3). Prom (A.3r), (6.3), and (6.6a), we can relate ImAn to (j{T) 
as follows: 

(6.11) (ImAii)e A 6^ = -de^ - [w(T) + ah-^ei{h) + 2a^]e A e\ 
In view of (6.10) and (6.11), we can express S in the following form: 

(6.12) S = -2[W + uj{T) + ah-^ei{h)]e A + d{4aQ - 2e^). 

In Euclidean 3-geometry, we take the interior product of the volume form with 
a vector field normal to a family of surfaces as a calibrating form ([HL]). This 2- 
form restricts to the area form on surfaces, and its exterior differentiation equals 
the mean curvature times the volume form along a surface. We have analogous 
results. Suppose M is foliated by a family of surfaces Sf, — e < t < e. Let ei be 
a vector field which is characteristic along any surface Sf. We arc assuming 's 
have no singular points. Let 62 = Jei denote the Lcgendrian normal along each 
E(. Then the 2-form $ = A dQ) satisfies the following properties. First, a 

direct computation shows that $ = O A 6^, our area 2-form from formula (A.lr). 
Secondly, d$ = —HQ A 6^ A by (6.2). So {St} are p-minimal surfaces if and 
only if (i$ = 0. Now suppose this is the case and S' is a deformed surface with no 
singular points near a p-minimal surface E = Eq having the same boundary. Also 
suppose the Poincare lemma holds. That is to say, there is a 1-form ^ such that 
$ = d^. Then by Stokes' theorem, we have 

(6.13) p-Area(E)= [ ^ = [ *= / *= / 

For E', wc have corresponding e\,e'2,e^' ^e^' . There is a function a' such that 
T + a' 62 is tangent to E'. Applying $ = 9 A 6^ to the basis (T -t- a' 63, e'J of TE', 
we obtain e^(e'i). It follows that $ = e^(e'i)6 A e^' when restricted to E'. So we 
have 

(6.14) 1^=1 e^{e'i)QAe'' 

< I e A 6^' = p - Area(E') (since 6^(6'i) < 1). 
From (6.13) and (6.14), we have shown that 

(6.15) p - Area(E) <p- Area{T,'). 
Let us summarize the above arguments in the following 
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Proposition 6.2. Suppose we can foliate an open neighborhood of a p-minimal 
surface T, by a family of p-niinimal surfaces with no singular points, and in this 
neighborhood the Poincare lemma holds (i.e., any closed 2- form is exact). Then 
E has the p- area-minimizing property. That is to say, if S' is a deformed surface 
with no singular points near E having the same boundary, then (6.15) holds. 

We remark that a p-minimal surface in Hi with no singular points, which is a 
graph over the xy-planc, satisfies the assumption in Proposition 6.2. Note that a 
translation of such a p-minimal graph in the z— axis is still p-minimal (quantitatively 
u-l-c is again a solution if m = u{x, y) is a solution to (pMGE)). Also a vertical (i.e. 
perpendicular to the xy-plane) plane in Hi satisfies the assumption in Proposition 
6.2. Note that a vertical plane is a p-minimal surface with no singular points, and 
a family of parallel such surfaces surely foliates an open neighborhood of a given 
one. 

7. Closed p-minimal surfaces in the standard and proof of Theorem 

E 

First let us describe the standard pseudohermitian 3-sphere (5^, J, O) (see the 
Appendix for the definition of basic notions) . The unit 3-spherc in inherits 
a standard contact structure £, = TS^ (1 Jc^ {TS^) where Jq^ denotes the almost 
complex structure of C^. The standard CR structure J compatible with ^ is nothing 
but the restriction of J^^ on ^. Let r = |C^P + |C^P - 1 where (C\C^) G C^- The 
contact form 9 = —idr = —i{(^d(^ + C^dC^) restricted to = {r = 0} gives rise 
to the Reeb vector field T = iC^di^i + iC^9^2 — iC^d^i — i^^d^2. Take the complex 
vector field Zi = C^9fi - C^9f2 and the complex 1-form 6^ = C'^dC^ - C^c^C^ such 
that {9,^1,^1} is dual to {f,Zi,Zi} and dO = iO^ A 9^. It follows that lo\ = 
—2iQ, Ai — in the corresponding {A.3) and (A.A) in the Appendix. Also in the 
corresponding (A. 5), W = 2. Write Zi = i(ei — 162) for real vector fields ei, 62- 
Let V^ '*- denote the pseudohermitian connection of (J, O). Prom V^ '^ Zi = uil ^ 
Zi (see (^.2)), we have 

(7.1) WP-'^-ei = -26 O 62, WP-^-e2 = 26 O ei. 

Recall that a Legendrian geodesic (with respect to V^ '' ) is a Legendrian curve 
7 such that V^'''"7 = 0. Here 7 = ^ is the imit tangent vector with respect to 
the Levi metric and s is a parameter of unit speed. A Legendrian great circle of 
{S^, J, 6) is a great circle in the usual sense, whose tangents belong to the kernel 
of 6. 

Lemma 7.1. In {S^, J, 6) a Legendrian geodesic is a part of a Legendrian great 
circle, and vice versa. 

Proof. Suppose 7 is a Legendrian geodesic. Write 7 = a(s)ei -I- b{s)e2 (note that 
ei and 62 = Jci belong to, and form a basis of, the kernel of 9). Compute = 
V?-'*7 = dei + be2 since V^''ei = V^'^ea = by (7.1) and 9(7) = 0. So a (6, 
respectively) is a constant ci (c2, respectively) along 7. Note that c^ + (^ = 1 since 
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+ 6^ = 1 by the unity of 7. Now write = + iy^, = x'^ + iy^. From the 
definition we can express 



(7.2) ei = x'^d^i ~ y'^dyi - x^d^2 + y^dy2, 
€.2 = y^d^i + x^dyi — y^dx2 — x^dy2. 

Writing 7(5) = {x^{s), y^ (s) , x'^ {s) , y^(s)), we can express the equation 7 = ciei + 
C2e2 by (7.2) as 

(7.3) x^ = cix'^ + C2y^, y^ = C2x'^ - ay'^, 

x^ = -cxx^ - C2y^,y^ = -C2X^ + ay^. 
It is easy to see from (7.3) that x^ = —x^, y^ = —y^, x^ = —x^, y^ = —y^. Therefore 

(7.4) {x^{s),y'^{s),x'^{s),y'^{s)) = cos{s){ai,a2,a3,a4) + sm{s){(3i, (32, p3, I^a)- 

Here the constant vector (/?i, /?2, p3, (3i) is determined by the constant vector (ai, a2, 0:3, a^) 
as follows: 



(7.5) /32) = (as, ^4) (j ""l ] , - ^2) 

\ C2 —Ci J y — C2 Cl 

Using cf + C2 = 1, we have 01^ 0\ = ag + , /3| + /3| = + by (7.5). Denote 
(ai, a2, as, 04) by a and P2, Pz, Pa) by /3. We can write (7.4) as 

(7.4') 7(s) = cos(s)a + sin(s)^. 

A direct computation using (7.5) and cf + = 1 shows that a is perpendicular 
to /3 and |a| = |/?| = 1 in since 7(s) e S^. It is now clear from (7.4') that the 
Legendrian geodesic 7(5), < s < 27r, is a great circle. Moreover, /? sits in the 
contact plane at the point a. Write Q = x^dy^ — y^dx^ + x'^dy^ — y^dx"^. Define 
(e, /)-*- = (— /, e) for a plane vector (e, /). Write a = (ai, 02) and /3 = (/3i, /32) for 
plane vectors di,a2, (3i, p2- Then /J e kerO at the point a if and only if 



(7.6) {di,ai) ■ 01 J2) = di-Pi+di-P2 = 

(in which " • " denotes the inner product). Now it is easy to see that (7.5) implies 
(7.6) for di = (ai,a2), a2 = (a3,a4), 0i = {Pi,P2), 02 = {03, (i4)- Conversely, given 
an arbitrary point d G and a unit tangent vector /3 in the contact plane at d, 
we claim that the great circle 7(5) defined by (7.4') is Legendrian and a Legendrian 
geodesic. From 7(5) = — sin(s)c5 + cos(s)/3, we compute 

{cos{s){dj^,d^) + iim{s){f3^ , (3^)} ■ {- sin(s)(ai, ^2) + cos(s)(/3i, ^2)} 
= - sm^{s){(3^ -di+Pi- ■ 02) + cos2(s)((S]L ■ f3i + dj^ ■ ^2) 
= dj- ■ (3i + d2 ■ P2 (since "fj ■ ( = ff-^ ■ (^-^ and {fj-^}'^ = —fj) 
= (by (7.6)). 
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So 7(5) is Legendrian by (7.6) again. From (7.2) we can express 61,62 at 7(s) as 
follows: 

ei(7(s)) = cos(s)(q;3, -ai, -ai, 0:2) + sin(s)(/33, -(3i, (32), 
62(7(5)) = cos(s)(q:4, 0:3, -a2, -ai) + sin(s)(/34,/33, -(32, -(3i). 

Recall that we write a = (ai, 02,03, 04), (3 = {(3\, 02,Pz,(3i). Equating (7(5) =) 
— sin(s)a + cos(,s),,9 = cif1i(7(.s)) + 6262(7(3)) with cl + c^ = I gives the equations 
(7.5) (requiring c\ + c\ = 1 gets rid of other equivalent equations). Solving (7.5) for 
ci, 62, we obtain ci = (/Sio^s- P20:4)ial + a|)^\ 62 = (/3ia4 + /32Q;3)(a§ + al)~'^ if 
al + al or ci = {-ai(33 + a2p4,){al + o^)^^ , C2 = (-ai/34 - a2/?3)(ei:f + Q;|)~^ 
if 0.1+0.2 ^ 0. Note that two expressions for ci (62, respectively) are equal where 
oj + al ^ and + a| 7^ by the condition (7.6) and a • /3 = 0. Now V^ '' 7 

= eiV^''* ei(7(s)) + 62 V^''*' 62(7(8)) = by (7.1). We have proved that 7(s) is a 
Legendrian geodesic. 

Q.E.D. 

Recall (see Section 2) that the p-mean curvature if of a surface S in a pseudoher- 
mitian 3-manifold (M, J, O) depends on (J, Q). Let H denote the p-mean curvature 
associated to another contact form G) = A^6, A > with J fixed. Let 62 denote 
the Legendrian normal to S. Then we have the following transformation law. 

Lemma 7.2. Suppose 9 = A^e, A > 0. Then H = X-'^{XH - 362(A)). 

Proof. Let ei denote the characteristic field with respect to 6. Then it follows 
from the definition that ei = A~^6i. Applying (5.7) in [Lee] to 61 (in our case, 
n = 1, Zi = ^(ei — ^62)), we obtain 

(7.7) \[bl{ii) = Loi^ei) - 3iX-'e2{\). 

Note that H = w(ei) = — iwi^(ei) (see the remark after (2.8)). Rewriting (7.7) in 
terms of H and H gives what we want. 

Q.E.D. 

We define the Cayley transform F: S'-\{{0,-l)} Hi by 

where (C\C^) € C satisfies |C^|^ + IC^P = 1 (see, e.g., [JL]). A direct 
computation shows that 

(7.8) e = F*{x^eo) 

where A^ = 4[42:^-|-(a;^-|-t/^ + l)^]~^ (recall that Qq = dz + xdy — ydx is the standard 
contact form for Hi). 

Lemma 7.3. Let S be a smoothly embedded p-minimal surface in {S^, J, &). 
Suppose p G T, is an isolated singular point. Then there exists a neighborhood V 
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of p in S such that V is contained in the union of all Legendrian great circles past 
P- 

Proof. Without loss of generality, we may assume (0,-1) ^ S. Consider Sq 
= F{T,) C Hi. Let Ho denote the p-mean curvature of Sq in Hi. By (7.8) and 
Lemma 7.2, wc obtain Hq = 3A~^e2(A). Here 62 is the Legendrian normal of Sq. 
Recall (Section 2) that 62 = — (cos0)ei — (sin0)e2. So e2(A) = — (cos6')ei(A) — 
(sin^)e2(A) is bounded near the isolated singular point F{p) since ei(A) and 62 (A) 
are global C°° smooth functions. Thus Hq is bounded near F(p) (Note that near 
a singular point, Sq is a graph over the xy-plane). Observing that characteristic 
curves and the singular set are preserved under the contact diffeomorphism F, we 
conclude the proof of the lemma by Theorem 3.10 and Lemma 7.1 . 

Q.E.D. 

A direct proof of Corollary F (for the nonexistence of hyperbolic p-minimal 
surfaces): 

Let S be a closed, connected, smoothly embedded p-minimal surface in 
{S^,J,&). Without loss of generality, we may assume (0,-1) ^ S. Consider Eq 
= F{T,) c ffi. As argued in the proof of Lemma 7.3, Hq, the p-mean curvature of 
Eo, is boimdcd. According to Theorem B any singular point of Eq is cither isolated 
or contained in a smooth singular curve with no other singular points near it 
(note that near a singular point, Eq is a graph over the a;y-plane). So back to E 
through F~^, wc can only have isolated singular points or closed singular curves 
on E. Similarly via the Cayley transform we can have an extension theorem anal- 
ogous to Corollary 3.6 with the characteristic curve replaced by a characteristic 
(Legendrian) great circle (arc) in the case of (S^, J, O). 

Now suppose E has an isolated singular point p. By Lemma 7.3 there exists a 
neighborhood F of p in E such that V is contained in the union of all Legendrian 
great circles past p. But this union simply forms a p-minimal 2-sphcrc. This 2- 
sphere must be the whole E since E is connected. Next suppose E does not have 
any isolated singular point. Then in view of the extension theorem, the space of 
leaves (Legendrian great circles) of the characteristic foliation (including touching 
points on singular curves) forms a closed, connected, 1-dimensional manifold. So it 
must be homeomorphic to S^. In this case, E is topologically a torus. 

Q.E.D. 

Example 1. Every coordinate sphere (defined by ^y^^x"^ or = 0) is a closed, 
connected, embedded p-minimal surface of genus in {S^, J, Q). For instance, we 
can write {y^ = 0} as the union of Legendrian great circles: 7t(s) = cos(s)(0, 0, 1, 0) 
-|- sin(s)(cos(t), sin(t), 0, 0) parametrized by t (it is a simple exercise to verify (7.6)). 

Example 2. Write — pie^'^^ , ("^ = p2e^'^^ in polar coordinates with pi+pi = 1 
on S^. We consider the surface Ec defined by pi — c, a constant between and 1. 
Note that 9 = pidipi+ p^dip^, Jd^ - = —pjdp. and Jdp. = pj^dy,. , j = 1, 2 in polar 
coordinates. Here we have used d^. = iC^d^j —i(^d^j, dp. = pJ^iC-'di^j +C"'9fj) for 
j = 1,2 (no summation convention here). Next we compute the Reeb vector field 
T, the characteristic field ei, and the Legendrian normal 62 as follows: 

T = 8:^^+ da,2,ei = —d^i - —8^^,62 = Jei = -p28pi + pi8p^. 

Pi P2 
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We then have = pip2{d(pi — d(p2) and = —p2dpi + p\dp2- So we can compute 
the p-area 2-form 9 A = —pip2d(pi A d(p2, the volume form 9 A A = pidpi A 
d(piAdip2 and d{QAe^) = —{p\ — p\)p2^dpiAdipiAdip2 (noting that Pidpi+p2dp2 = 
0). By (6.2) we obtain the p-mean curvature H = {p2 — Pi){piP2)~^ = P2Pi^ — PiP2^ 
for Sc where < = c < 1 and p2 = VT^-c^. Thus for c = \/2/2 {pi = p2 = 
c), Ec is a closed, connected, embedded p-minimal torus with no singular points 
(observing that T is tangent at every point of Sc) and the union of Legendrian 
great circles defined by tpi + <^2 = a, < a < 27r with identified with 27r. In any 
case, Sc is a torus of constant p-mean curvature. Also note that the p-minimal 
torus S^^2 is not stable. This can be seen from the second variation formula (6.8) 
in which a = 0, An = 0, and W = 2. 

We can generalize Corollary F to the situation that the ambient pseudohermitian 
3-manifold is spherical. A pseudohermitian 3-manifold is called spherical if it is 

locally CR equivalent to {S^ , J). 

Proof of Theorem E : Locally near a singular point of S, we may assume that 
E is a smooth graph over the xy-plane in (i?^, Jq, A^9o) for (C°° smooth) 
A > 0. Here (Jo,0o) denotes the standard pseudohermitian structure of Hi (see 
the Appendix). By Lemma 7.2, the p-mean curvature of S with respect to ( Jq, 9o) 
equals 3A~^e2(A) -I- A(original p-mean curvature) which is a bounded function by 
assumption and the boundcdncss of 62 (A) (for the same reason as in the proof of 
Lemma 7.3). So the singular set Sy, (depending only on S and the contact structure) 
consists of finitely many isolated points and smooth closed curves in view of 
Theorem B. Also the extension theorems (Corollary 3.6 and Theorem 3.10) hold in 
this situation. Now the configuration of characteristic foliation on S is clear. The 
associated line field (extended to include those defined on points of singular curves) 
has only isolated singular points of index 1 in view of Lemma 3.8. Therefore the 
total index sum of this line field is nonnegative. This index sum is equal to the 
Euler characteristic number of the surface E according to the Hopf index theorem 
for a line field (e.g., [Sp]). On the other hand, the Euler characteristic number of 
E equals 2 — 25(E) where ^(E) denotes the genus of E. It follows that 5(E) < 1. 

Q.E.D. 

Appendix. Basic facts in pseudohermitian geometry 

Let M be a smooth (paracompact) 3-manifold. A contact structure or bundle 
^ on M is a completely nonintegrable plane distribution. A contact form is a 1- 
form annihilating ^. Let {M,S^) be a contact 3-manifold with an oriented contact 
structure ^. We say a contact form 9 is oriented if dQ{u, v) > Q for {u, v) being an 
oriented basis of ^. There always exists a global oriented contact form 9, obtained 
by patching together local ones with a partition of unity. The Reeb vector field of 
9 is the unique vector field T such that 9(T) = 1 and £t9 = or d9(T, •) = 0. 
A Cii-structure compatible with ^ is a smooth endomorphism J : ^ — > ^ such that 
,P = —Identity. We say J is oriented if (X, JX) is an oriented basis of ^ for any 
nonzero X € S,. A pseudohermitian structure compatible with ^ is a Ci?-structure 
J compatible with ^ together with a global contact form 9. 

Given a pseudohermitian structure { J, 9), we can choose a complex vector field 
Zi, an eigenvector of J with eigenvalue i, and a complex 1-form 6^ such that 
{e,e^,e^} is dual to {T,Zi,Zi} {e^ = {6^),Zi = {Zi]). it follows that de = 
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ihiiO^AO^ for some nonzero real function hii. If both J and 0are oriented, then 
hii is positive. In this case wc call such a pscudohcrmitian structure (J, ©) oriented, 
and we can choose a Zx (hence 9^) such that hii = 1. That is to say 

(A.l) de = z6'^A6'\ 

We will always assume our pseudohermitian structure is oriented and hn = 1. 
The pseudohermitian connection of (J, 6) is the connection V^'^' on TM®C (and 
extended to tensors) given by 

(A.2) V^-^-Zx=ijJx^®Zx,V^-^-Z-x=ijj^^®Z-x,V^-^-T = ^ 

in which the 1-form uj\ - is uniquely determined by the following equation with a 
normalization condition ([Ta], [We]): 

(A.3) dO^ = e^Aoji^ + A^iQAe'^, 

(A.4) uji'^ + uji^ = 0. 

The coefficient A^i in {A.3) is called the (pseudohermitian) torsion. Since hn = 1, 
All = /^ii^^i = ^^1- And All is just the complex conjugate of ^jj. Differentiating 
wi^ gives 

(A.5) duji^ = W9^A9^ + 2i/m(Aii,i6'iAe) 

where W is the Tanaka- Webster curvature. Write uJi^ = ioj for some real 1-form uj 
by (^.4). This uj is just the one used in previous sections. Write Zi = \{e\ — ie^) 
for real vectors ei,e2. It follows that = Jei- Let = Re{9^),e^ = Im{6^). 
Then {e° = 6, e\ e^} is dual to {eo = T, 61,62}. Now in view of (^.1), (^.2) and 
{A.2)), we have the following real version of structure equations: 

(A.lr) de = 2e^Ae2, 

(A.2r) V^'-^-ei = a; (g) 62, •''•62 = -w O d, 

(A.3r) de^ = -(? A w mod O; de^ = A w mod 9. 

Similarly, from (A.5), we have the following equation for W: 

(A.5r) cL;(ei,e2) = -2W. 

Also by (A.l), (A.3) we can deduce 

(A.6) {Zi,Zy\=%T + UJx^{Zi)Zy->^-^{Z{)Zi, 

(A.7) \Zi,T\ = A\Z^-u:-^{T)Zi. 

The real version of (A.6), (A.7) reads 
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(A.6r) [ei, 62] = -IT - w(ei)ei - u){ei)e-2, 

(A.7r) [ei, T] = (Re^ii)ei - ((ImAn) + a;(T))e2, 

[62, T] = -((Im^n) + w(T))ei + (ReAn)e2. 

Note that Ajj = ^^1 since hx\ = 1. We define the subgradient operator Vb acting 
on a smooth function / by 

(A.8) Vfc/ = 2{(Zi/)Zi + (Zi/)Zi}. 

It is easy to see that the definition of Vb is independent of the choice of unitary 
{h\\ = 1) frame Zi. The real version of {A.8) reads 



(A.8r) Vfc/ = (ei/)ei + (e2/)e2. 

Next we will introduce the 3-dimensional Heisenberg group Hi (see, e.g., [FS]). 
For two points {x,y,z), {x',y',z') G R^, we define the multiplication as follows: 
(x, y, z) o (x', y', z') = (x + x' , y + y', z + z' + yx' — xy'). endowed with this 
multiplication "o" forms a Lie group, called the (3-dimensional) Heisenberg group 
and denoted as Hi. It is a simple exercise to verify that: 

d d ^ d d d 
ox oz ay oz oz 
form a basis for the left-invariant vector fields on Hi. We can endow Hi with 
a standard pseudohermitian structure. The plane distribution spanned by 61,62 
forms a contact structure ^0 (so that ei, 62 are Legendrian, i.e., sitting in the contact 
plane). The CR structure Jo compatible with ^0 is defined by Jo(ei) = 62, Jo(e2) = 
—61. The contact form 60 = dz + xdy — ydx gives rise to the Reeb vector field To = 
Observe that {dx, dy, 9o} is dual to {ei, 62, To} and d{dx + idy) = 0. It follows 
from the structural equations (A. 3), (A. 4) and (A. 5) that the connection form 
associated to the coframe dx + idy, the torsion and the Tanaka- Webster curvature 
are all zero. 
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